2026-02-24T17:17:23.991 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T17:17:24.006 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:17:24.093 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468 branch: wip-yuri8-testing-2026-02-23-2128 description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/{bluestore/{alloc$/{hybrid} base mem$/{low} onode-segment$/{512K-onoff} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '68468' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri8-testing-2026-02-23-2128 ceph: conf: client: debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 2500 ms tcp read timeout: 5 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mgrc: 20 debug mon: 30 debug ms: 1 debug paxos: 20 mon scrub interval: 300 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore debug onode segmentation random: true bluestore fsck on mount: true bluestore onode segment size: 512K bluestore write v2 random: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd inject bad map crc probability: 0.1 osd max markdown count: 1000 osd max scrubs: 1 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true crush_tunables: jewel flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* - reached quota - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) sha1: 618c318a7a0b287ab5aeff207b7bf1d73ef45044 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 618c318a7a0b287ab5aeff207b7bf1d73ef45044 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2026-02-23-2128 sha1: 618c318a7a0b287ab5aeff207b7bf1d73ef45044 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 6922 sha1: 618c318a7a0b287ab5aeff207b7bf1d73ef45044 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri8-testing-2026-02-23-2128 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_618c318a7a0b287ab5aeff207b7bf1d73ef45044/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 618c318a7a0b287ab5aeff207b7bf1d73ef45044 targets: trial040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLuqOTzP1NO3g8ZDv/vaKjr73ObC3zk/OCly+gxxMZRLjgD/1GD60vGqOMcRim5M74mbn8hFJXJ/dAoxvMXMHzM= trial094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqwYqHkNOLn3ydD/CUc0eNO7GKSmzl2zOTRLEvxdwPzzhsIORCm66PAgXr3wcBCGfO8H0ySW0HAZjDALR6YVVM= trial109.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/1pL8AoWwBWj3DTuH8Cc7gyQzfVgSO2IKdi487aeKKz9bGiEItomtThHltMTBnjD/H1zo3G0VGj8G4EMJ2U2Y= trial120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGjt6UdtOAuqapCEU0dIm5Yh3eQ2o0tX9eURatVkNpz33lhdHppSmyhNIY78UHoofhwWCI6wIh0fxAoyBh1GIE4= tasks: - install: null - ceph: conf: osd: debug monc: 20 - workunit: clients: client.0: - rados/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_16:03:54 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T17:17:24.094 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_618c318a7a0b287ab5aeff207b7bf1d73ef45044/qa; will attempt to use it 2026-02-24T17:17:24.094 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_618c318a7a0b287ab5aeff207b7bf1d73ef45044/qa/tasks 2026-02-24T17:17:24.094 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-24T17:17:24.096 INFO:teuthology.task.internal:Checking packages... 2026-02-24T17:17:24.096 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '618c318a7a0b287ab5aeff207b7bf1d73ef45044' 2026-02-24T17:17:24.096 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-24T17:17:24.096 INFO:teuthology.packaging:ref: None 2026-02-24T17:17:24.096 INFO:teuthology.packaging:tag: None 2026-02-24T17:17:24.096 INFO:teuthology.packaging:branch: wip-yuri8-testing-2026-02-23-2128 2026-02-24T17:17:24.096 INFO:teuthology.packaging:sha1: 618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:17:24.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri8-testing-2026-02-23-2128 2026-02-24T17:17:24.216 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:17:24.218 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-24T17:17:24.232 INFO:teuthology.task.internal:no buildpackages task found 2026-02-24T17:17:24.232 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T17:17:24.242 INFO:teuthology.task.internal:Saving configuration 2026-02-24T17:17:24.256 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T17:17:24.266 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T17:17:24.343 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial040.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 17:13:48.144435', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINnNMj42VRVje3P9FOVHGNVFxmnoTelryxh1vhzQv1Dr'} 2026-02-24T17:17:24.401 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial094.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 17:13:48.145009', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPSztpTXOSOv0JlCv/RDLBk5FhRoejBBOwf5ZgbJplnS'} 2026-02-24T17:17:24.457 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial109.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 17:13:48.145709', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIC4QSAaeX9OGYYdVNegDXg2caToxAerkNRmYCgwlhoNb'} 2026-02-24T17:17:24.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial120.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 17:13:48.145356', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHJ89jWQsFrEBOBseMF59YktaWnNLJuXHTl7eAO6hxwY'} 2026-02-24T17:17:24.514 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T17:17:24.526 INFO:teuthology.task.internal:roles: ubuntu@trial040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-24T17:17:24.526 INFO:teuthology.task.internal:roles: ubuntu@trial094.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-24T17:17:24.526 INFO:teuthology.task.internal:roles: ubuntu@trial109.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-24T17:17:24.526 INFO:teuthology.task.internal:roles: ubuntu@trial120.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-24T17:17:24.526 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T17:17:24.791 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a409e3f2ca0>, signals=[15]) 2026-02-24T17:17:24.791 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T17:17:24.803 INFO:teuthology.task.internal:Opening connections... 2026-02-24T17:17:24.803 DEBUG:teuthology.task.internal:connecting to ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:17:24.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:17:24.868 DEBUG:teuthology.task.internal:connecting to ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:17:24.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:17:24.931 DEBUG:teuthology.task.internal:connecting to ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:17:24.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:17:24.992 DEBUG:teuthology.task.internal:connecting to ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:17:24.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:17:25.056 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T17:17:25.067 DEBUG:teuthology.orchestra.run.trial040:> uname -m 2026-02-24T17:17:25.071 INFO:teuthology.orchestra.run.trial040.stdout:x86_64 2026-02-24T17:17:25.071 DEBUG:teuthology.orchestra.run.trial040:> cat /etc/os-release 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:NAME="Ubuntu" 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_ID="22.04" 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_CODENAME=jammy 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:ID=ubuntu 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:ID_LIKE=debian 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-24T17:17:25.115 INFO:teuthology.orchestra.run.trial040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-24T17:17:25.116 INFO:teuthology.orchestra.run.trial040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-24T17:17:25.116 INFO:teuthology.orchestra.run.trial040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-24T17:17:25.116 INFO:teuthology.orchestra.run.trial040.stdout:UBUNTU_CODENAME=jammy 2026-02-24T17:17:25.116 INFO:teuthology.lock.ops:Updating trial040.front.sepia.ceph.com on lock server 2026-02-24T17:17:25.186 DEBUG:teuthology.orchestra.run.trial094:> uname -m 2026-02-24T17:17:25.190 INFO:teuthology.orchestra.run.trial094.stdout:x86_64 2026-02-24T17:17:25.190 DEBUG:teuthology.orchestra.run.trial094:> cat /etc/os-release 2026-02-24T17:17:25.237 INFO:teuthology.orchestra.run.trial094.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-24T17:17:25.237 INFO:teuthology.orchestra.run.trial094.stdout:NAME="Ubuntu" 2026-02-24T17:17:25.237 INFO:teuthology.orchestra.run.trial094.stdout:VERSION_ID="22.04" 2026-02-24T17:17:25.237 INFO:teuthology.orchestra.run.trial094.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-24T17:17:25.237 INFO:teuthology.orchestra.run.trial094.stdout:VERSION_CODENAME=jammy 2026-02-24T17:17:25.238 INFO:teuthology.orchestra.run.trial094.stdout:ID=ubuntu 2026-02-24T17:17:25.238 INFO:teuthology.orchestra.run.trial094.stdout:ID_LIKE=debian 2026-02-24T17:17:25.238 INFO:teuthology.orchestra.run.trial094.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-24T17:17:25.238 INFO:teuthology.orchestra.run.trial094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-24T17:17:25.238 INFO:teuthology.orchestra.run.trial094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-24T17:17:25.238 INFO:teuthology.orchestra.run.trial094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-24T17:17:25.238 INFO:teuthology.orchestra.run.trial094.stdout:UBUNTU_CODENAME=jammy 2026-02-24T17:17:25.238 INFO:teuthology.lock.ops:Updating trial094.front.sepia.ceph.com on lock server 2026-02-24T17:17:25.311 DEBUG:teuthology.orchestra.run.trial109:> uname -m 2026-02-24T17:17:25.315 INFO:teuthology.orchestra.run.trial109.stdout:x86_64 2026-02-24T17:17:25.315 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release 2026-02-24T17:17:25.361 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:NAME="Ubuntu" 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="22.04" 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_CODENAME=jammy 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:ID=ubuntu 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE=debian 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-24T17:17:25.362 INFO:teuthology.orchestra.run.trial109.stdout:UBUNTU_CODENAME=jammy 2026-02-24T17:17:25.362 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server 2026-02-24T17:17:25.436 DEBUG:teuthology.orchestra.run.trial120:> uname -m 2026-02-24T17:17:25.441 INFO:teuthology.orchestra.run.trial120.stdout:x86_64 2026-02-24T17:17:25.441 DEBUG:teuthology.orchestra.run.trial120:> cat /etc/os-release 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:NAME="Ubuntu" 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:VERSION_ID="22.04" 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:VERSION_CODENAME=jammy 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:ID=ubuntu 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:ID_LIKE=debian 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-24T17:17:25.486 INFO:teuthology.orchestra.run.trial120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-24T17:17:25.487 INFO:teuthology.orchestra.run.trial120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-24T17:17:25.487 INFO:teuthology.orchestra.run.trial120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-24T17:17:25.487 INFO:teuthology.orchestra.run.trial120.stdout:UBUNTU_CODENAME=jammy 2026-02-24T17:17:25.487 INFO:teuthology.lock.ops:Updating trial120.front.sepia.ceph.com on lock server 2026-02-24T17:17:25.565 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T17:17:25.579 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T17:17:25.590 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T17:17:25.590 DEBUG:teuthology.orchestra.run.trial040:> test '!' -e /home/ubuntu/cephtest 2026-02-24T17:17:25.591 DEBUG:teuthology.orchestra.run.trial094:> test '!' -e /home/ubuntu/cephtest 2026-02-24T17:17:25.593 DEBUG:teuthology.orchestra.run.trial109:> test '!' -e /home/ubuntu/cephtest 2026-02-24T17:17:25.594 DEBUG:teuthology.orchestra.run.trial120:> test '!' -e /home/ubuntu/cephtest 2026-02-24T17:17:25.597 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T17:17:25.608 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T17:17:25.608 DEBUG:teuthology.orchestra.run.trial040:> test -z $(ls -A /var/lib/ceph) 2026-02-24T17:17:25.636 DEBUG:teuthology.orchestra.run.trial094:> test -z $(ls -A /var/lib/ceph) 2026-02-24T17:17:25.640 INFO:teuthology.orchestra.run.trial040.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-24T17:17:25.643 DEBUG:teuthology.orchestra.run.trial109:> test -z $(ls -A /var/lib/ceph) 2026-02-24T17:17:25.645 DEBUG:teuthology.orchestra.run.trial120:> test -z $(ls -A /var/lib/ceph) 2026-02-24T17:17:25.646 INFO:teuthology.orchestra.run.trial094.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-24T17:17:25.648 INFO:teuthology.orchestra.run.trial109.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-24T17:17:25.650 INFO:teuthology.orchestra.run.trial120.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-24T17:17:25.650 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T17:17:25.944 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T17:17:25.969 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-24T17:17:25.969 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-24T17:17:25.970 DEBUG:teuthology.orchestra.run.trial040:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T17:17:25.970 DEBUG:teuthology.orchestra.run.trial094:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T17:17:25.970 DEBUG:teuthology.orchestra.run.trial109:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T17:17:25.970 DEBUG:teuthology.orchestra.run.trial120:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T17:17:25.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:17:25.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:17:25.974 DEBUG:teuthology.orchestra.run.trial040:> uname -r 2026-02-24T17:17:25.974 DEBUG:teuthology.orchestra.run.trial094:> uname -r 2026-02-24T17:17:25.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:17:25.974 DEBUG:teuthology.orchestra.run.trial120:> uname -r 2026-02-24T17:17:25.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:17:25.975 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-24T17:17:26.018 INFO:teuthology.orchestra.run.trial040.stdout:5.15.0-170-generic 2026-02-24T17:17:26.018 INFO:teuthology.task.kernel:Running kernel on trial040: 5.15.0-170-generic 2026-02-24T17:17:26.018 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get clean 2026-02-24T17:17:26.020 INFO:teuthology.orchestra.run.trial094.stdout:5.15.0-170-generic 2026-02-24T17:17:26.020 INFO:teuthology.task.kernel:Running kernel on trial094: 5.15.0-170-generic 2026-02-24T17:17:26.020 DEBUG:teuthology.orchestra.run.trial094:> sudo apt-get clean 2026-02-24T17:17:26.021 INFO:teuthology.orchestra.run.trial109.stdout:5.15.0-170-generic 2026-02-24T17:17:26.022 INFO:teuthology.task.kernel:Running kernel on trial109: 5.15.0-170-generic 2026-02-24T17:17:26.022 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get clean 2026-02-24T17:17:26.022 INFO:teuthology.orchestra.run.trial120.stdout:5.15.0-170-generic 2026-02-24T17:17:26.022 INFO:teuthology.task.kernel:Running kernel on trial120: 5.15.0-170-generic 2026-02-24T17:17:26.022 DEBUG:teuthology.orchestra.run.trial120:> sudo apt-get clean 2026-02-24T17:17:26.076 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get update 2026-02-24T17:17:26.078 DEBUG:teuthology.orchestra.run.trial094:> sudo apt-get update 2026-02-24T17:17:26.079 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get update 2026-02-24T17:17:26.080 DEBUG:teuthology.orchestra.run.trial120:> sudo apt-get update 2026-02-24T17:17:26.293 INFO:teuthology.orchestra.run.trial040.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:17:26.301 INFO:teuthology.orchestra.run.trial040.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-24T17:17:26.342 INFO:teuthology.orchestra.run.trial040.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-24T17:17:26.358 INFO:teuthology.orchestra.run.trial040.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-24T17:17:26.435 INFO:teuthology.orchestra.run.trial040.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3269 kB] 2026-02-24T17:17:26.500 INFO:teuthology.orchestra.run.trial040.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [497 kB] 2026-02-24T17:17:26.503 INFO:teuthology.orchestra.run.trial040.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.2 kB] 2026-02-24T17:17:26.503 INFO:teuthology.orchestra.run.trial040.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-24T17:17:26.510 INFO:teuthology.orchestra.run.trial040.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-24T17:17:26.512 INFO:teuthology.orchestra.run.trial040.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.4 kB] 2026-02-24T17:17:26.512 INFO:teuthology.orchestra.run.trial040.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5379 kB] 2026-02-24T17:17:26.528 INFO:teuthology.orchestra.run.trial094.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:17:26.537 INFO:teuthology.orchestra.run.trial040.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1022 kB] 2026-02-24T17:17:26.540 INFO:teuthology.orchestra.run.trial040.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [3005 kB] 2026-02-24T17:17:26.550 INFO:teuthology.orchestra.run.trial040.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [429 kB] 2026-02-24T17:17:26.551 INFO:teuthology.orchestra.run.trial040.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-24T17:17:26.551 INFO:teuthology.orchestra.run.trial040.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-24T17:17:26.554 INFO:teuthology.orchestra.run.trial040.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [225 kB] 2026-02-24T17:17:26.555 INFO:teuthology.orchestra.run.trial040.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-24T17:17:26.555 INFO:teuthology.orchestra.run.trial040.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5204 kB] 2026-02-24T17:17:26.572 INFO:teuthology.orchestra.run.trial040.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [990 kB] 2026-02-24T17:17:26.573 INFO:teuthology.orchestra.run.trial109.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:17:26.578 INFO:teuthology.orchestra.run.trial120.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:17:26.601 INFO:teuthology.orchestra.run.trial094.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-24T17:17:26.664 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-24T17:17:26.669 INFO:teuthology.orchestra.run.trial120.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-24T17:17:26.877 INFO:teuthology.orchestra.run.trial094.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-24T17:17:27.001 INFO:teuthology.orchestra.run.trial109.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-24T17:17:27.002 INFO:teuthology.orchestra.run.trial094.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-24T17:17:27.007 INFO:teuthology.orchestra.run.trial120.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-24T17:17:27.117 INFO:teuthology.orchestra.run.trial094.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3269 kB] 2026-02-24T17:17:27.149 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-24T17:17:27.157 INFO:teuthology.orchestra.run.trial120.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-24T17:17:27.289 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3269 kB] 2026-02-24T17:17:27.297 INFO:teuthology.orchestra.run.trial120.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3269 kB] 2026-02-24T17:17:27.445 INFO:teuthology.orchestra.run.trial094.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [497 kB] 2026-02-24T17:17:27.455 INFO:teuthology.orchestra.run.trial094.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.2 kB] 2026-02-24T17:17:27.455 INFO:teuthology.orchestra.run.trial094.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-24T17:17:27.483 INFO:teuthology.orchestra.run.trial094.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-24T17:17:27.489 INFO:teuthology.orchestra.run.trial094.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.4 kB] 2026-02-24T17:17:27.490 INFO:teuthology.orchestra.run.trial094.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5379 kB] 2026-02-24T17:17:27.665 INFO:teuthology.orchestra.run.trial094.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1022 kB] 2026-02-24T17:17:27.680 INFO:teuthology.orchestra.run.trial094.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [3005 kB] 2026-02-24T17:17:27.690 INFO:teuthology.orchestra.run.trial109.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [497 kB] 2026-02-24T17:17:27.699 INFO:teuthology.orchestra.run.trial120.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [497 kB] 2026-02-24T17:17:27.702 INFO:teuthology.orchestra.run.trial109.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.2 kB] 2026-02-24T17:17:27.703 INFO:teuthology.orchestra.run.trial109.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-24T17:17:27.711 INFO:teuthology.orchestra.run.trial120.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.2 kB] 2026-02-24T17:17:27.712 INFO:teuthology.orchestra.run.trial120.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-24T17:17:27.737 INFO:teuthology.orchestra.run.trial109.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-24T17:17:27.744 INFO:teuthology.orchestra.run.trial109.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.4 kB] 2026-02-24T17:17:27.745 INFO:teuthology.orchestra.run.trial109.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5379 kB] 2026-02-24T17:17:27.746 INFO:teuthology.orchestra.run.trial120.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-24T17:17:27.748 INFO:teuthology.orchestra.run.trial094.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [429 kB] 2026-02-24T17:17:27.753 INFO:teuthology.orchestra.run.trial120.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.4 kB] 2026-02-24T17:17:27.754 INFO:teuthology.orchestra.run.trial120.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5379 kB] 2026-02-24T17:17:27.766 INFO:teuthology.orchestra.run.trial094.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-24T17:17:27.766 INFO:teuthology.orchestra.run.trial094.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-24T17:17:27.796 INFO:teuthology.orchestra.run.trial094.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [225 kB] 2026-02-24T17:17:27.804 INFO:teuthology.orchestra.run.trial094.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-24T17:17:27.805 INFO:teuthology.orchestra.run.trial094.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5204 kB] 2026-02-24T17:17:27.904 INFO:teuthology.orchestra.run.trial109.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1022 kB] 2026-02-24T17:17:27.912 INFO:teuthology.orchestra.run.trial120.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1022 kB] 2026-02-24T17:17:27.920 INFO:teuthology.orchestra.run.trial094.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [990 kB] 2026-02-24T17:17:27.926 INFO:teuthology.orchestra.run.trial109.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [3005 kB] 2026-02-24T17:17:27.935 INFO:teuthology.orchestra.run.trial120.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [3005 kB] 2026-02-24T17:17:28.013 INFO:teuthology.orchestra.run.trial109.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [429 kB] 2026-02-24T17:17:28.020 INFO:teuthology.orchestra.run.trial109.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-24T17:17:28.021 INFO:teuthology.orchestra.run.trial109.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-24T17:17:28.022 INFO:teuthology.orchestra.run.trial120.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [429 kB] 2026-02-24T17:17:28.033 INFO:teuthology.orchestra.run.trial120.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-24T17:17:28.033 INFO:teuthology.orchestra.run.trial120.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-24T17:17:28.056 INFO:teuthology.orchestra.run.trial109.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [225 kB] 2026-02-24T17:17:28.064 INFO:teuthology.orchestra.run.trial109.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-24T17:17:28.064 INFO:teuthology.orchestra.run.trial109.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5204 kB] 2026-02-24T17:17:28.067 INFO:teuthology.orchestra.run.trial120.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [225 kB] 2026-02-24T17:17:28.077 INFO:teuthology.orchestra.run.trial120.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-24T17:17:28.077 INFO:teuthology.orchestra.run.trial120.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5204 kB] 2026-02-24T17:17:28.216 INFO:teuthology.orchestra.run.trial109.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [990 kB] 2026-02-24T17:17:28.223 INFO:teuthology.orchestra.run.trial120.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [990 kB] 2026-02-24T17:17:30.570 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 23.1 MB in 2s (13.0 MB/s) 2026-02-24T17:17:31.116 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-24T17:17:31.130 DEBUG:teuthology.orchestra.run.trial040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-24T17:17:31.165 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-24T17:17:31.278 INFO:teuthology.orchestra.run.trial040.stdout:Building dependency tree... 2026-02-24T17:17:31.279 INFO:teuthology.orchestra.run.trial040.stdout:Reading state information... 2026-02-24T17:17:31.369 INFO:teuthology.orchestra.run.trial040.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:17:31.369 INFO:teuthology.orchestra.run.trial040.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:17:31.369 INFO:teuthology.orchestra.run.trial040.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-24T17:17:31.369 INFO:teuthology.orchestra.run.trial040.stdout: sg3-utils-udev 2026-02-24T17:17:31.369 INFO:teuthology.orchestra.run.trial040.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:17:31.369 INFO:teuthology.orchestra.run.trial040.stdout:The following additional packages will be installed: 2026-02-24T17:17:31.369 INFO:teuthology.orchestra.run.trial040.stdout: linux-generic linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-24T17:17:31.369 INFO:teuthology.orchestra.run.trial040.stdout: linux-headers-generic linux-image-5.15.0-171-generic 2026-02-24T17:17:31.370 INFO:teuthology.orchestra.run.trial040.stdout: linux-modules-5.15.0-171-generic linux-modules-extra-5.15.0-171-generic 2026-02-24T17:17:31.370 INFO:teuthology.orchestra.run.trial040.stdout:Suggested packages: 2026-02-24T17:17:31.370 INFO:teuthology.orchestra.run.trial040.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-24T17:17:31.383 INFO:teuthology.orchestra.run.trial040.stdout:The following NEW packages will be installed: 2026-02-24T17:17:31.383 INFO:teuthology.orchestra.run.trial040.stdout: linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-24T17:17:31.383 INFO:teuthology.orchestra.run.trial040.stdout: linux-image-5.15.0-171-generic linux-modules-5.15.0-171-generic 2026-02-24T17:17:31.383 INFO:teuthology.orchestra.run.trial040.stdout: linux-modules-extra-5.15.0-171-generic 2026-02-24T17:17:31.384 INFO:teuthology.orchestra.run.trial040.stdout:The following packages will be upgraded: 2026-02-24T17:17:31.384 INFO:teuthology.orchestra.run.trial040.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-24T17:17:31.450 INFO:teuthology.orchestra.run.trial094.stdout:Fetched 23.1 MB in 3s (8605 kB/s) 2026-02-24T17:17:31.657 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 23.1 MB in 3s (7909 kB/s) 2026-02-24T17:17:31.677 INFO:teuthology.orchestra.run.trial120.stdout:Fetched 23.1 MB in 3s (7915 kB/s) 2026-02-24T17:17:31.730 INFO:teuthology.orchestra.run.trial040.stdout:3 upgraded, 5 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:17:31.730 INFO:teuthology.orchestra.run.trial040.stdout:Need to get 113 MB of archives. 2026-02-24T17:17:31.730 INFO:teuthology.orchestra.run.trial040.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-24T17:17:31.730 INFO:teuthology.orchestra.run.trial040.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-171-generic amd64 5.15.0-171.181 [22.7 MB] 2026-02-24T17:17:31.983 INFO:teuthology.orchestra.run.trial094.stdout:Reading package lists... 2026-02-24T17:17:31.997 DEBUG:teuthology.orchestra.run.trial094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-24T17:17:32.030 INFO:teuthology.orchestra.run.trial094.stdout:Reading package lists... 2026-02-24T17:17:32.139 INFO:teuthology.orchestra.run.trial094.stdout:Building dependency tree... 2026-02-24T17:17:32.140 INFO:teuthology.orchestra.run.trial094.stdout:Reading state information... 2026-02-24T17:17:32.185 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-24T17:17:32.198 DEBUG:teuthology.orchestra.run.trial109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-24T17:17:32.203 INFO:teuthology.orchestra.run.trial120.stdout:Reading package lists... 2026-02-24T17:17:32.216 DEBUG:teuthology.orchestra.run.trial120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout: sg3-utils-udev 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout:The following additional packages will be installed: 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout: linux-generic linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout: linux-headers-generic linux-image-5.15.0-171-generic 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout: linux-modules-5.15.0-171-generic linux-modules-extra-5.15.0-171-generic 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout:Suggested packages: 2026-02-24T17:17:32.229 INFO:teuthology.orchestra.run.trial094.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-24T17:17:32.230 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-24T17:17:32.243 INFO:teuthology.orchestra.run.trial094.stdout:The following NEW packages will be installed: 2026-02-24T17:17:32.243 INFO:teuthology.orchestra.run.trial094.stdout: linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-24T17:17:32.243 INFO:teuthology.orchestra.run.trial094.stdout: linux-image-5.15.0-171-generic linux-modules-5.15.0-171-generic 2026-02-24T17:17:32.243 INFO:teuthology.orchestra.run.trial094.stdout: linux-modules-extra-5.15.0-171-generic 2026-02-24T17:17:32.243 INFO:teuthology.orchestra.run.trial094.stdout:The following packages will be upgraded: 2026-02-24T17:17:32.244 INFO:teuthology.orchestra.run.trial094.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-24T17:17:32.249 INFO:teuthology.orchestra.run.trial120.stdout:Reading package lists... 2026-02-24T17:17:32.339 INFO:teuthology.orchestra.run.trial109.stdout:Building dependency tree... 2026-02-24T17:17:32.339 INFO:teuthology.orchestra.run.trial109.stdout:Reading state information... 2026-02-24T17:17:32.360 INFO:teuthology.orchestra.run.trial120.stdout:Building dependency tree... 2026-02-24T17:17:32.360 INFO:teuthology.orchestra.run.trial120.stdout:Reading state information... 2026-02-24T17:17:32.426 INFO:teuthology.orchestra.run.trial109.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:17:32.426 INFO:teuthology.orchestra.run.trial109.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:17:32.426 INFO:teuthology.orchestra.run.trial109.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-24T17:17:32.426 INFO:teuthology.orchestra.run.trial109.stdout: sg3-utils-udev 2026-02-24T17:17:32.426 INFO:teuthology.orchestra.run.trial109.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:17:32.426 INFO:teuthology.orchestra.run.trial109.stdout:The following additional packages will be installed: 2026-02-24T17:17:32.426 INFO:teuthology.orchestra.run.trial109.stdout: linux-generic linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-24T17:17:32.427 INFO:teuthology.orchestra.run.trial109.stdout: linux-headers-generic linux-image-5.15.0-171-generic 2026-02-24T17:17:32.427 INFO:teuthology.orchestra.run.trial109.stdout: linux-modules-5.15.0-171-generic linux-modules-extra-5.15.0-171-generic 2026-02-24T17:17:32.427 INFO:teuthology.orchestra.run.trial109.stdout:Suggested packages: 2026-02-24T17:17:32.427 INFO:teuthology.orchestra.run.trial109.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-24T17:17:32.440 INFO:teuthology.orchestra.run.trial109.stdout:The following NEW packages will be installed: 2026-02-24T17:17:32.440 INFO:teuthology.orchestra.run.trial109.stdout: linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-24T17:17:32.440 INFO:teuthology.orchestra.run.trial109.stdout: linux-image-5.15.0-171-generic linux-modules-5.15.0-171-generic 2026-02-24T17:17:32.440 INFO:teuthology.orchestra.run.trial109.stdout: linux-modules-extra-5.15.0-171-generic 2026-02-24T17:17:32.440 INFO:teuthology.orchestra.run.trial109.stdout:The following packages will be upgraded: 2026-02-24T17:17:32.440 INFO:teuthology.orchestra.run.trial109.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout: sg3-utils-udev 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout:The following additional packages will be installed: 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout: linux-generic linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout: linux-headers-generic linux-image-5.15.0-171-generic 2026-02-24T17:17:32.447 INFO:teuthology.orchestra.run.trial120.stdout: linux-modules-5.15.0-171-generic linux-modules-extra-5.15.0-171-generic 2026-02-24T17:17:32.448 INFO:teuthology.orchestra.run.trial120.stdout:Suggested packages: 2026-02-24T17:17:32.448 INFO:teuthology.orchestra.run.trial120.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-24T17:17:32.461 INFO:teuthology.orchestra.run.trial120.stdout:The following NEW packages will be installed: 2026-02-24T17:17:32.461 INFO:teuthology.orchestra.run.trial120.stdout: linux-headers-5.15.0-171 linux-headers-5.15.0-171-generic 2026-02-24T17:17:32.461 INFO:teuthology.orchestra.run.trial120.stdout: linux-image-5.15.0-171-generic linux-modules-5.15.0-171-generic 2026-02-24T17:17:32.461 INFO:teuthology.orchestra.run.trial120.stdout: linux-modules-extra-5.15.0-171-generic 2026-02-24T17:17:32.461 INFO:teuthology.orchestra.run.trial120.stdout:The following packages will be upgraded: 2026-02-24T17:17:32.461 INFO:teuthology.orchestra.run.trial120.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-24T17:17:32.541 INFO:teuthology.orchestra.run.trial109.stdout:3 upgraded, 5 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:17:32.541 INFO:teuthology.orchestra.run.trial109.stdout:Need to get 113 MB of archives. 2026-02-24T17:17:32.541 INFO:teuthology.orchestra.run.trial109.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-24T17:17:32.541 INFO:teuthology.orchestra.run.trial109.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-171-generic amd64 5.15.0-171.181 [22.7 MB] 2026-02-24T17:17:32.590 INFO:teuthology.orchestra.run.trial094.stdout:3 upgraded, 5 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:17:32.590 INFO:teuthology.orchestra.run.trial094.stdout:Need to get 113 MB of archives. 2026-02-24T17:17:32.590 INFO:teuthology.orchestra.run.trial094.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-24T17:17:32.590 INFO:teuthology.orchestra.run.trial094.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-171-generic amd64 5.15.0-171.181 [22.7 MB] 2026-02-24T17:17:32.704 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-171-generic amd64 5.15.0-171.181 [11.6 MB] 2026-02-24T17:17:32.752 INFO:teuthology.orchestra.run.trial109.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-171-generic amd64 5.15.0-171.181 [63.9 MB] 2026-02-24T17:17:32.822 INFO:teuthology.orchestra.run.trial040.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-171-generic amd64 5.15.0-171.181 [11.6 MB] 2026-02-24T17:17:32.870 INFO:teuthology.orchestra.run.trial120.stdout:3 upgraded, 5 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:17:32.870 INFO:teuthology.orchestra.run.trial120.stdout:Need to get 113 MB of archives. 2026-02-24T17:17:32.870 INFO:teuthology.orchestra.run.trial120.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-24T17:17:32.870 INFO:teuthology.orchestra.run.trial120.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-171-generic amd64 5.15.0-171.181 [22.7 MB] 2026-02-24T17:17:33.037 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.171.160 [1658 B] 2026-02-24T17:17:33.037 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.171.160 [2486 B] 2026-02-24T17:17:33.037 INFO:teuthology.orchestra.run.trial109.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171 all 5.15.0-171.181 [12.4 MB] 2026-02-24T17:17:33.088 INFO:teuthology.orchestra.run.trial109.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171-generic amd64 5.15.0-171.181 [2849 kB] 2026-02-24T17:17:33.091 INFO:teuthology.orchestra.run.trial040.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-171-generic amd64 5.15.0-171.181 [63.9 MB] 2026-02-24T17:17:33.099 INFO:teuthology.orchestra.run.trial109.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.171.160 [2332 B] 2026-02-24T17:17:33.296 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 113 MB in 1s (172 MB/s) 2026-02-24T17:17:33.318 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-modules-5.15.0-171-generic. 2026-02-24T17:17:33.492 INFO:teuthology.orchestra.run.trial109.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-24T17:17:33.494 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../0-linux-modules-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:33.496 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:33.688 INFO:teuthology.orchestra.run.trial094.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-171-generic amd64 5.15.0-171.181 [11.6 MB] 2026-02-24T17:17:33.825 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-image-5.15.0-171-generic. 2026-02-24T17:17:33.833 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../1-linux-image-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:33.851 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:33.891 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-171-generic. 2026-02-24T17:17:33.900 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:33.900 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:33.960 INFO:teuthology.orchestra.run.trial094.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-171-generic amd64 5.15.0-171.181 [63.9 MB] 2026-02-24T17:17:34.209 INFO:teuthology.orchestra.run.trial120.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-171-generic amd64 5.15.0-171.181 [11.6 MB] 2026-02-24T17:17:34.538 INFO:teuthology.orchestra.run.trial120.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-171-generic amd64 5.15.0-171.181 [63.9 MB] 2026-02-24T17:17:34.584 INFO:teuthology.orchestra.run.trial040.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.171.160 [1658 B] 2026-02-24T17:17:34.585 INFO:teuthology.orchestra.run.trial040.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.171.160 [2486 B] 2026-02-24T17:17:34.585 INFO:teuthology.orchestra.run.trial040.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171 all 5.15.0-171.181 [12.4 MB] 2026-02-24T17:17:34.861 INFO:teuthology.orchestra.run.trial040.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171-generic amd64 5.15.0-171.181 [2849 kB] 2026-02-24T17:17:34.927 INFO:teuthology.orchestra.run.trial040.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.171.160 [2332 B] 2026-02-24T17:17:34.999 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../3-linux-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:35.000 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:35.025 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:35.025 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-image-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:35.042 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-headers-5.15.0-171. 2026-02-24T17:17:35.050 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../5-linux-headers-5.15.0-171_5.15.0-171.181_all.deb ... 2026-02-24T17:17:35.050 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-24T17:17:35.125 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 113 MB in 4s (32.0 MB/s) 2026-02-24T17:17:35.146 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-modules-5.15.0-171-generic. 2026-02-24T17:17:35.320 INFO:teuthology.orchestra.run.trial040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-24T17:17:35.322 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../0-linux-modules-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:35.323 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:35.457 INFO:teuthology.orchestra.run.trial094.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.171.160 [1658 B] 2026-02-24T17:17:35.457 INFO:teuthology.orchestra.run.trial094.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.171.160 [2486 B] 2026-02-24T17:17:35.457 INFO:teuthology.orchestra.run.trial094.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171 all 5.15.0-171.181 [12.4 MB] 2026-02-24T17:17:35.661 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-image-5.15.0-171-generic. 2026-02-24T17:17:35.670 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../1-linux-image-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:35.690 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:35.730 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-171-generic. 2026-02-24T17:17:35.739 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:35.739 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:36.003 INFO:teuthology.orchestra.run.trial094.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171-generic amd64 5.15.0-171.181 [2849 kB] 2026-02-24T17:17:36.110 INFO:teuthology.orchestra.run.trial094.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.171.160 [2332 B] 2026-02-24T17:17:36.309 INFO:teuthology.orchestra.run.trial094.stdout:Fetched 113 MB in 4s (29.3 MB/s) 2026-02-24T17:17:36.329 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package linux-modules-5.15.0-171-generic. 2026-02-24T17:17:36.363 INFO:teuthology.orchestra.run.trial120.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.171.160 [1658 B] 2026-02-24T17:17:36.364 INFO:teuthology.orchestra.run.trial120.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.171.160 [2486 B] 2026-02-24T17:17:36.364 INFO:teuthology.orchestra.run.trial120.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171 all 5.15.0-171.181 [12.4 MB] 2026-02-24T17:17:36.435 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-headers-5.15.0-171-generic. 2026-02-24T17:17:36.450 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../6-linux-headers-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:36.450 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:36.501 INFO:teuthology.orchestra.run.trial094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-24T17:17:36.503 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../0-linux-modules-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:36.504 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:36.705 INFO:teuthology.orchestra.run.trial120.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-171-generic amd64 5.15.0-171.181 [2849 kB] 2026-02-24T17:17:36.786 INFO:teuthology.orchestra.run.trial120.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.171.160 [2332 B] 2026-02-24T17:17:36.858 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package linux-image-5.15.0-171-generic. 2026-02-24T17:17:36.867 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../1-linux-image-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:36.876 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../3-linux-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:36.877 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:36.888 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:36.902 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:36.903 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-image-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:36.919 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-headers-5.15.0-171. 2026-02-24T17:17:36.928 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../5-linux-headers-5.15.0-171_5.15.0-171.181_all.deb ... 2026-02-24T17:17:36.929 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-171-generic. 2026-02-24T17:17:36.929 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-24T17:17:36.937 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:36.937 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:36.982 INFO:teuthology.orchestra.run.trial120.stdout:Fetched 113 MB in 4s (26.2 MB/s) 2026-02-24T17:17:37.000 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package linux-modules-5.15.0-171-generic. 2026-02-24T17:17:37.034 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:37.035 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-headers-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:37.061 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-24T17:17:37.062 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:37.063 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-headers-generic (5.15.0.171.160) ... 2026-02-24T17:17:37.065 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:37.172 INFO:teuthology.orchestra.run.trial120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-24T17:17:37.174 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../0-linux-modules-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:37.175 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:37.526 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package linux-image-5.15.0-171-generic. 2026-02-24T17:17:37.534 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../1-linux-image-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:37.556 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:37.597 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-171-generic. 2026-02-24T17:17:37.606 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:37.606 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:37.832 INFO:teuthology.orchestra.run.trial109.stdout:I: /boot/vmlinuz.old is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-24T17:17:37.832 INFO:teuthology.orchestra.run.trial109.stdout:I: /boot/initrd.img.old is now a symlink to initrd.img-5.15.0-170-generic 2026-02-24T17:17:37.832 INFO:teuthology.orchestra.run.trial109.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-171-generic 2026-02-24T17:17:37.833 INFO:teuthology.orchestra.run.trial109.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-171-generic 2026-02-24T17:17:37.840 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:38.039 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../3-linux-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:38.040 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking linux-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:38.065 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:38.065 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking linux-image-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:38.082 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package linux-headers-5.15.0-171. 2026-02-24T17:17:38.091 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../5-linux-headers-5.15.0-171_5.15.0-171.181_all.deb ... 2026-02-24T17:17:38.092 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-24T17:17:38.266 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-headers-5.15.0-171-generic. 2026-02-24T17:17:38.281 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../6-linux-headers-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:38.281 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:38.636 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:38.699 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../3-linux-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:38.700 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking linux-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:38.725 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:38.726 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking linux-image-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:38.743 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package linux-headers-5.15.0-171. 2026-02-24T17:17:38.752 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../5-linux-headers-5.15.0-171_5.15.0-171.181_all.deb ... 2026-02-24T17:17:38.752 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-24T17:17:38.887 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:38.888 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-headers-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:38.914 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-24T17:17:38.915 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:38.916 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-headers-generic (5.15.0.171.160) ... 2026-02-24T17:17:38.918 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:39.429 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-image-generic (5.15.0.171.160) ... 2026-02-24T17:17:39.430 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-generic (5.15.0.171.160) ... 2026-02-24T17:17:39.431 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:39.437 INFO:teuthology.orchestra.run.trial109.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-24T17:17:39.437 INFO:teuthology.orchestra.run.trial109.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:39.455 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package linux-headers-5.15.0-171-generic. 2026-02-24T17:17:39.469 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../6-linux-headers-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:39.469 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:39.708 INFO:teuthology.orchestra.run.trial040.stdout:I: /boot/vmlinuz.old is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-24T17:17:39.708 INFO:teuthology.orchestra.run.trial040.stdout:I: /boot/initrd.img.old is now a symlink to initrd.img-5.15.0-170-generic 2026-02-24T17:17:39.709 INFO:teuthology.orchestra.run.trial040.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-171-generic 2026-02-24T17:17:39.709 INFO:teuthology.orchestra.run.trial040.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-171-generic 2026-02-24T17:17:39.715 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:40.061 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:40.062 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking linux-headers-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:40.088 INFO:teuthology.orchestra.run.trial094.stdout:Setting up linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-24T17:17:40.089 INFO:teuthology.orchestra.run.trial094.stdout:Setting up linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:40.090 INFO:teuthology.orchestra.run.trial094.stdout:Setting up linux-headers-generic (5.15.0.171.160) ... 2026-02-24T17:17:40.092 INFO:teuthology.orchestra.run.trial094.stdout:Setting up linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:40.141 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package linux-headers-5.15.0-171-generic. 2026-02-24T17:17:40.155 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../6-linux-headers-5.15.0-171-generic_5.15.0-171.181_amd64.deb ... 2026-02-24T17:17:40.156 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:40.530 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:40.749 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.171.160_amd64.deb ... 2026-02-24T17:17:40.750 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking linux-headers-generic (5.15.0.171.160) over (5.15.0.170.159) ... 2026-02-24T17:17:40.776 INFO:teuthology.orchestra.run.trial120.stdout:Setting up linux-headers-5.15.0-171 (5.15.0-171.181) ... 2026-02-24T17:17:40.778 INFO:teuthology.orchestra.run.trial120.stdout:Setting up linux-headers-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:40.779 INFO:teuthology.orchestra.run.trial120.stdout:Setting up linux-headers-generic (5.15.0.171.160) ... 2026-02-24T17:17:40.781 INFO:teuthology.orchestra.run.trial120.stdout:Setting up linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:40.868 INFO:teuthology.orchestra.run.trial094.stdout:I: /boot/vmlinuz.old is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-24T17:17:40.869 INFO:teuthology.orchestra.run.trial094.stdout:I: /boot/initrd.img.old is now a symlink to initrd.img-5.15.0-170-generic 2026-02-24T17:17:40.869 INFO:teuthology.orchestra.run.trial094.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-171-generic 2026-02-24T17:17:40.869 INFO:teuthology.orchestra.run.trial094.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-171-generic 2026-02-24T17:17:40.876 INFO:teuthology.orchestra.run.trial094.stdout:Setting up linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:41.345 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-image-generic (5.15.0.171.160) ... 2026-02-24T17:17:41.346 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-generic (5.15.0.171.160) ... 2026-02-24T17:17:41.347 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:41.352 INFO:teuthology.orchestra.run.trial040.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-24T17:17:41.352 INFO:teuthology.orchestra.run.trial040.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:41.585 INFO:teuthology.orchestra.run.trial120.stdout:I: /boot/vmlinuz.old is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-24T17:17:41.585 INFO:teuthology.orchestra.run.trial120.stdout:I: /boot/initrd.img.old is now a symlink to initrd.img-5.15.0-170-generic 2026-02-24T17:17:41.585 INFO:teuthology.orchestra.run.trial120.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-171-generic 2026-02-24T17:17:41.586 INFO:teuthology.orchestra.run.trial120.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-171-generic 2026-02-24T17:17:41.593 INFO:teuthology.orchestra.run.trial120.stdout:Setting up linux-modules-extra-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:41.682 INFO:teuthology.orchestra.run.trial094.stdout:Setting up linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:42.420 INFO:teuthology.orchestra.run.trial120.stdout:Setting up linux-modules-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:42.486 INFO:teuthology.orchestra.run.trial094.stdout:Setting up linux-image-generic (5.15.0.171.160) ... 2026-02-24T17:17:42.488 INFO:teuthology.orchestra.run.trial094.stdout:Setting up linux-generic (5.15.0.171.160) ... 2026-02-24T17:17:42.489 INFO:teuthology.orchestra.run.trial094.stdout:Processing triggers for linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:42.494 INFO:teuthology.orchestra.run.trial094.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-24T17:17:42.494 INFO:teuthology.orchestra.run.trial094.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:43.235 INFO:teuthology.orchestra.run.trial120.stdout:Setting up linux-image-generic (5.15.0.171.160) ... 2026-02-24T17:17:43.236 INFO:teuthology.orchestra.run.trial120.stdout:Setting up linux-generic (5.15.0.171.160) ... 2026-02-24T17:17:43.238 INFO:teuthology.orchestra.run.trial120.stdout:Processing triggers for linux-image-5.15.0-171-generic (5.15.0-171.181) ... 2026-02-24T17:17:43.243 INFO:teuthology.orchestra.run.trial120.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-24T17:17:43.243 INFO:teuthology.orchestra.run.trial120.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:46.510 INFO:teuthology.orchestra.run.trial109.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-24T17:17:48.440 INFO:teuthology.orchestra.run.trial040.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-24T17:17:49.561 INFO:teuthology.orchestra.run.trial094.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-24T17:17:50.326 INFO:teuthology.orchestra.run.trial120.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-24T17:17:53.135 INFO:teuthology.orchestra.run.trial109.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-24T17:17:53.135 INFO:teuthology.orchestra.run.trial109.stdout:Sourcing file `/etc/default/grub' 2026-02-24T17:17:53.154 INFO:teuthology.orchestra.run.trial109.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-24T17:17:53.155 INFO:teuthology.orchestra.run.trial109.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-24T17:17:53.158 INFO:teuthology.orchestra.run.trial109.stdout:Generating grub configuration file ... 2026-02-24T17:17:53.242 INFO:teuthology.orchestra.run.trial109.stdout:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-24T17:17:53.248 INFO:teuthology.orchestra.run.trial109.stdout:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:53.421 INFO:teuthology.orchestra.run.trial109.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-24T17:17:53.426 INFO:teuthology.orchestra.run.trial109.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-24T17:17:53.471 INFO:teuthology.orchestra.run.trial109.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-24T17:17:53.477 INFO:teuthology.orchestra.run.trial109.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-24T17:17:53.554 INFO:teuthology.orchestra.run.trial109.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-24T17:17:53.554 INFO:teuthology.orchestra.run.trial109.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-24T17:17:53.554 INFO:teuthology.orchestra.run.trial109.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-24T17:17:53.557 INFO:teuthology.orchestra.run.trial109.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T17:17:53.566 INFO:teuthology.orchestra.run.trial109.stdout:done 2026-02-24T17:17:53.959 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.959 INFO:teuthology.orchestra.run.trial109.stdout:Pending kernel upgrade! 2026-02-24T17:17:53.959 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout:Running kernel version: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: 5.15.0-170-generic 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout:Diagnostics: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: The currently running kernel version is not the expected kernel version 5.15.0-171-generic. 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout:The processor microcode seems to be up-to-date. 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout:No services need to be restarted. 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout:No containers need to be restarted. 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout:No user sessions are running outdated binaries. 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:17:53.960 INFO:teuthology.orchestra.run.trial109.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-24T17:17:54.794 DEBUG:teuthology.orchestra.run.trial109:> dpkg -s linux-image-generic 2026-02-24T17:17:54.844 INFO:teuthology.orchestra.run.trial109.stdout:Package: linux-image-generic 2026-02-24T17:17:54.844 INFO:teuthology.orchestra.run.trial109.stdout:Status: install ok installed 2026-02-24T17:17:54.844 INFO:teuthology.orchestra.run.trial109.stdout:Priority: optional 2026-02-24T17:17:54.844 INFO:teuthology.orchestra.run.trial109.stdout:Section: kernel 2026-02-24T17:17:54.845 INFO:teuthology.orchestra.run.trial109.stdout:Installed-Size: 22 2026-02-24T17:17:54.845 INFO:teuthology.orchestra.run.trial109.stdout:Maintainer: Ubuntu Kernel Team 2026-02-24T17:17:54.845 INFO:teuthology.orchestra.run.trial109.stdout:Architecture: amd64 2026-02-24T17:17:54.845 INFO:teuthology.orchestra.run.trial109.stdout:Source: linux-meta 2026-02-24T17:17:54.845 INFO:teuthology.orchestra.run.trial109.stdout:Version: 5.15.0.171.160 2026-02-24T17:17:54.845 INFO:teuthology.orchestra.run.trial109.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-24T17:17:54.846 INFO:teuthology.orchestra.run.trial109.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-24T17:17:54.846 INFO:teuthology.orchestra.run.trial109.stdout:Recommends: thermald 2026-02-24T17:17:54.846 INFO:teuthology.orchestra.run.trial109.stdout:Description: Generic Linux kernel image 2026-02-24T17:17:54.846 INFO:teuthology.orchestra.run.trial109.stdout: This package will always depend on the latest generic kernel image 2026-02-24T17:17:54.846 INFO:teuthology.orchestra.run.trial109.stdout: available. 2026-02-24T17:17:54.847 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-170-generic Expected: 5.15.0-171-generic 2026-02-24T17:17:54.847 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T17:17:54.847 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T17:17:54.847 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-24T17:17:54.848 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial109.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T17:17:54.848 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get clean 2026-02-24T17:17:54.927 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get update 2026-02-24T17:17:55.074 INFO:teuthology.orchestra.run.trial040.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-24T17:17:55.074 INFO:teuthology.orchestra.run.trial040.stdout:Sourcing file `/etc/default/grub' 2026-02-24T17:17:55.094 INFO:teuthology.orchestra.run.trial040.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-24T17:17:55.095 INFO:teuthology.orchestra.run.trial040.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-24T17:17:55.098 INFO:teuthology.orchestra.run.trial040.stdout:Generating grub configuration file ... 2026-02-24T17:17:55.182 INFO:teuthology.orchestra.run.trial040.stdout:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-24T17:17:55.189 INFO:teuthology.orchestra.run.trial040.stdout:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:55.367 INFO:teuthology.orchestra.run.trial040.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-24T17:17:55.373 INFO:teuthology.orchestra.run.trial040.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-24T17:17:55.417 INFO:teuthology.orchestra.run.trial040.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-24T17:17:55.422 INFO:teuthology.orchestra.run.trial040.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-24T17:17:55.452 INFO:teuthology.orchestra.run.trial109.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:17:55.496 INFO:teuthology.orchestra.run.trial040.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-24T17:17:55.496 INFO:teuthology.orchestra.run.trial040.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-24T17:17:55.496 INFO:teuthology.orchestra.run.trial040.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-24T17:17:55.498 INFO:teuthology.orchestra.run.trial040.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T17:17:55.507 INFO:teuthology.orchestra.run.trial040.stdout:done 2026-02-24T17:17:55.539 INFO:teuthology.orchestra.run.trial109.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-24T17:17:55.631 INFO:teuthology.orchestra.run.trial109.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-24T17:17:55.722 INFO:teuthology.orchestra.run.trial109.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout:Pending kernel upgrade! 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout:Running kernel version: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: 5.15.0-170-generic 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout:Diagnostics: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: The currently running kernel version is not the expected kernel version 5.15.0-171-generic. 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout:The processor microcode seems to be up-to-date. 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout:No services need to be restarted. 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.917 INFO:teuthology.orchestra.run.trial040.stdout:No containers need to be restarted. 2026-02-24T17:17:55.918 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.918 INFO:teuthology.orchestra.run.trial040.stdout:No user sessions are running outdated binaries. 2026-02-24T17:17:55.918 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:17:55.918 INFO:teuthology.orchestra.run.trial040.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-24T17:17:56.177 INFO:teuthology.orchestra.run.trial094.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-24T17:17:56.177 INFO:teuthology.orchestra.run.trial094.stdout:Sourcing file `/etc/default/grub' 2026-02-24T17:17:56.195 INFO:teuthology.orchestra.run.trial094.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-24T17:17:56.196 INFO:teuthology.orchestra.run.trial094.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-24T17:17:56.199 INFO:teuthology.orchestra.run.trial094.stdout:Generating grub configuration file ... 2026-02-24T17:17:56.282 INFO:teuthology.orchestra.run.trial094.stdout:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-24T17:17:56.288 INFO:teuthology.orchestra.run.trial094.stdout:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:56.372 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-24T17:17:56.387 DEBUG:teuthology.orchestra.run.trial109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-24T17:17:56.420 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-24T17:17:56.462 INFO:teuthology.orchestra.run.trial094.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-24T17:17:56.467 INFO:teuthology.orchestra.run.trial094.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-24T17:17:56.510 INFO:teuthology.orchestra.run.trial094.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-24T17:17:56.515 INFO:teuthology.orchestra.run.trial094.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-24T17:17:56.532 INFO:teuthology.orchestra.run.trial109.stdout:Building dependency tree... 2026-02-24T17:17:56.533 INFO:teuthology.orchestra.run.trial109.stdout:Reading state information... 2026-02-24T17:17:56.590 INFO:teuthology.orchestra.run.trial094.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-24T17:17:56.591 INFO:teuthology.orchestra.run.trial094.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-24T17:17:56.591 INFO:teuthology.orchestra.run.trial094.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-24T17:17:56.593 INFO:teuthology.orchestra.run.trial094.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T17:17:56.601 INFO:teuthology.orchestra.run.trial094.stdout:done 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout:linux-image-generic is already the newest version (5.15.0.171.160). 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout:linux-image-generic set to manually installed. 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-24T17:17:56.619 INFO:teuthology.orchestra.run.trial109.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:17:56.639 INFO:teuthology.orchestra.run.trial109.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:17:56.641 DEBUG:teuthology.orchestra.run.trial109:> dpkg -s linux-image-generic 2026-02-24T17:17:56.690 INFO:teuthology.orchestra.run.trial109.stdout:Package: linux-image-generic 2026-02-24T17:17:56.690 INFO:teuthology.orchestra.run.trial109.stdout:Status: install ok installed 2026-02-24T17:17:56.690 INFO:teuthology.orchestra.run.trial109.stdout:Priority: optional 2026-02-24T17:17:56.690 INFO:teuthology.orchestra.run.trial109.stdout:Section: kernel 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Installed-Size: 22 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Maintainer: Ubuntu Kernel Team 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Architecture: amd64 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Source: linux-meta 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Version: 5.15.0.171.160 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Recommends: thermald 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout:Description: Generic Linux kernel image 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout: This package will always depend on the latest generic kernel image 2026-02-24T17:17:56.691 INFO:teuthology.orchestra.run.trial109.stdout: available. 2026-02-24T17:17:56.691 DEBUG:teuthology.orchestra.run.trial109:> mktemp 2026-02-24T17:17:56.738 INFO:teuthology.orchestra.run.trial109.stdout:/tmp/tmp.m3HhswwwRt 2026-02-24T17:17:56.739 DEBUG:teuthology.orchestra.run.trial109:> sudo cp /boot/grub/grub.cfg /tmp/tmp.m3HhswwwRt 2026-02-24T17:17:56.769 DEBUG:teuthology.orchestra.run.trial040:> dpkg -s linux-image-generic 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Package: linux-image-generic 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Status: install ok installed 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Priority: optional 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Section: kernel 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Installed-Size: 22 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Maintainer: Ubuntu Kernel Team 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Architecture: amd64 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Source: linux-meta 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Version: 5.15.0.171.160 2026-02-24T17:17:56.778 INFO:teuthology.orchestra.run.trial040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-24T17:17:56.779 INFO:teuthology.orchestra.run.trial040.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-24T17:17:56.779 INFO:teuthology.orchestra.run.trial040.stdout:Recommends: thermald 2026-02-24T17:17:56.779 INFO:teuthology.orchestra.run.trial040.stdout:Description: Generic Linux kernel image 2026-02-24T17:17:56.779 INFO:teuthology.orchestra.run.trial040.stdout: This package will always depend on the latest generic kernel image 2026-02-24T17:17:56.779 INFO:teuthology.orchestra.run.trial040.stdout: available. 2026-02-24T17:17:56.780 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-170-generic Expected: 5.15.0-171-generic 2026-02-24T17:17:56.780 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T17:17:56.780 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T17:17:56.780 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-24T17:17:56.780 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial040.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T17:17:56.780 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get clean 2026-02-24T17:17:56.790 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 0666 /tmp/tmp.m3HhswwwRt 2026-02-24T17:17:56.860 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get update 2026-02-24T17:17:56.884 DEBUG:teuthology.orchestra.remote:trial109:/tmp/tmp.m3HhswwwRt is 9KB 2026-02-24T17:17:56.894 DEBUG:teuthology.orchestra.run.trial109:> rm -fr /tmp/tmp.m3HhswwwRt 2026-02-24T17:17:56.898 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-24T17:17:56.935 INFO:teuthology.orchestra.run.trial120.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-24T17:17:56.935 INFO:teuthology.orchestra.run.trial120.stdout:Sourcing file `/etc/default/grub' 2026-02-24T17:17:56.946 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:17:56.946 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-24T17:17:56.946 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-24T17:17:56.955 INFO:teuthology.orchestra.run.trial120.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-24T17:17:56.956 INFO:teuthology.orchestra.run.trial120.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-24T17:17:56.958 INFO:teuthology.orchestra.run.trial120.stdout:Generating grub configuration file ... 2026-02-24T17:17:57.000 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-171-generic 2026-02-24T17:17:57.000 DEBUG:teuthology.orchestra.run.trial109:> sudo update-grub 2026-02-24T17:17:57.006 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout:Pending kernel upgrade! 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout:Running kernel version: 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout: 5.15.0-170-generic 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout:Diagnostics: 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout: The currently running kernel version is not the expected kernel version 5.15.0-171-generic. 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.007 INFO:teuthology.orchestra.run.trial094.stdout:The processor microcode seems to be up-to-date. 2026-02-24T17:17:57.008 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.008 INFO:teuthology.orchestra.run.trial094.stdout:No services need to be restarted. 2026-02-24T17:17:57.008 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.008 INFO:teuthology.orchestra.run.trial094.stdout:No containers need to be restarted. 2026-02-24T17:17:57.008 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.008 INFO:teuthology.orchestra.run.trial094.stdout:No user sessions are running outdated binaries. 2026-02-24T17:17:57.008 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:17:57.008 INFO:teuthology.orchestra.run.trial094.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-24T17:17:57.037 INFO:teuthology.orchestra.run.trial120.stdout:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-24T17:17:57.044 INFO:teuthology.orchestra.run.trial120.stdout:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:57.204 INFO:teuthology.orchestra.run.trial120.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-24T17:17:57.209 INFO:teuthology.orchestra.run.trial120.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-24T17:17:57.239 INFO:teuthology.orchestra.run.trial109.stderr:Sourcing file `/etc/default/grub' 2026-02-24T17:17:57.252 INFO:teuthology.orchestra.run.trial120.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-24T17:17:57.257 INFO:teuthology.orchestra.run.trial120.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-24T17:17:57.259 INFO:teuthology.orchestra.run.trial109.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-24T17:17:57.260 INFO:teuthology.orchestra.run.trial109.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-24T17:17:57.262 INFO:teuthology.orchestra.run.trial109.stderr:Generating grub configuration file ... 2026-02-24T17:17:57.288 INFO:teuthology.orchestra.run.trial040.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:17:57.333 INFO:teuthology.orchestra.run.trial120.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-24T17:17:57.333 INFO:teuthology.orchestra.run.trial120.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-24T17:17:57.333 INFO:teuthology.orchestra.run.trial120.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-24T17:17:57.335 INFO:teuthology.orchestra.run.trial120.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T17:17:57.344 INFO:teuthology.orchestra.run.trial120.stdout:done 2026-02-24T17:17:57.345 INFO:teuthology.orchestra.run.trial109.stderr:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-24T17:17:57.350 INFO:teuthology.orchestra.run.trial109.stderr:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:57.354 INFO:teuthology.orchestra.run.trial040.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-24T17:17:57.426 INFO:teuthology.orchestra.run.trial040.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-24T17:17:57.500 INFO:teuthology.orchestra.run.trial040.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-24T17:17:57.526 INFO:teuthology.orchestra.run.trial109.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-24T17:17:57.532 INFO:teuthology.orchestra.run.trial109.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-24T17:17:57.575 INFO:teuthology.orchestra.run.trial109.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-24T17:17:57.580 INFO:teuthology.orchestra.run.trial109.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-24T17:17:57.655 INFO:teuthology.orchestra.run.trial109.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-24T17:17:57.655 INFO:teuthology.orchestra.run.trial109.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-24T17:17:57.655 INFO:teuthology.orchestra.run.trial109.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-24T17:17:57.657 INFO:teuthology.orchestra.run.trial109.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T17:17:57.665 INFO:teuthology.orchestra.run.trial109.stderr:done 2026-02-24T17:17:57.666 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial109 2026-02-24T17:17:57.666 DEBUG:teuthology.orchestra.run.trial109:> sudo bash -c ' 2026-02-24T17:17:57.666 DEBUG:teuthology.orchestra.run.trial109:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T17:17:57.667 DEBUG:teuthology.orchestra.run.trial109:> ' 2026-02-24T17:17:57.760 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.760 INFO:teuthology.orchestra.run.trial120.stdout:Pending kernel upgrade! 2026-02-24T17:17:57.760 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.760 INFO:teuthology.orchestra.run.trial120.stdout:Running kernel version: 2026-02-24T17:17:57.760 INFO:teuthology.orchestra.run.trial120.stdout: 5.15.0-170-generic 2026-02-24T17:17:57.760 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.760 INFO:teuthology.orchestra.run.trial120.stdout:Diagnostics: 2026-02-24T17:17:57.760 INFO:teuthology.orchestra.run.trial120.stdout: The currently running kernel version is not the expected kernel version 5.15.0-171-generic. 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout:The processor microcode seems to be up-to-date. 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout:No services need to be restarted. 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout:No containers need to be restarted. 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout:No user sessions are running outdated binaries. 2026-02-24T17:17:57.761 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:17:57.762 INFO:teuthology.orchestra.run.trial120.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-24T17:17:57.831 DEBUG:teuthology.orchestra.run.trial094:> dpkg -s linux-image-generic 2026-02-24T17:17:57.883 INFO:teuthology.orchestra.run.trial094.stdout:Package: linux-image-generic 2026-02-24T17:17:57.883 INFO:teuthology.orchestra.run.trial094.stdout:Status: install ok installed 2026-02-24T17:17:57.883 INFO:teuthology.orchestra.run.trial094.stdout:Priority: optional 2026-02-24T17:17:57.883 INFO:teuthology.orchestra.run.trial094.stdout:Section: kernel 2026-02-24T17:17:57.883 INFO:teuthology.orchestra.run.trial094.stdout:Installed-Size: 22 2026-02-24T17:17:57.883 INFO:teuthology.orchestra.run.trial094.stdout:Maintainer: Ubuntu Kernel Team 2026-02-24T17:17:57.883 INFO:teuthology.orchestra.run.trial094.stdout:Architecture: amd64 2026-02-24T17:17:57.884 INFO:teuthology.orchestra.run.trial094.stdout:Source: linux-meta 2026-02-24T17:17:57.884 INFO:teuthology.orchestra.run.trial094.stdout:Version: 5.15.0.171.160 2026-02-24T17:17:57.884 INFO:teuthology.orchestra.run.trial094.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-24T17:17:57.884 INFO:teuthology.orchestra.run.trial094.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-24T17:17:57.884 INFO:teuthology.orchestra.run.trial094.stdout:Recommends: thermald 2026-02-24T17:17:57.884 INFO:teuthology.orchestra.run.trial094.stdout:Description: Generic Linux kernel image 2026-02-24T17:17:57.884 INFO:teuthology.orchestra.run.trial094.stdout: This package will always depend on the latest generic kernel image 2026-02-24T17:17:57.884 INFO:teuthology.orchestra.run.trial094.stdout: available. 2026-02-24T17:17:57.885 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-170-generic Expected: 5.15.0-171-generic 2026-02-24T17:17:57.885 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T17:17:57.886 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T17:17:57.886 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-24T17:17:57.886 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial094.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T17:17:57.886 DEBUG:teuthology.orchestra.run.trial094:> sudo apt-get clean 2026-02-24T17:17:57.965 DEBUG:teuthology.orchestra.run.trial094:> sudo apt-get update 2026-02-24T17:17:58.171 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-24T17:17:58.185 DEBUG:teuthology.orchestra.run.trial040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-24T17:17:58.219 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-24T17:17:58.334 INFO:teuthology.orchestra.run.trial040.stdout:Building dependency tree... 2026-02-24T17:17:58.335 INFO:teuthology.orchestra.run.trial040.stdout:Reading state information... 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout:linux-image-generic is already the newest version (5.15.0.171.160). 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout:linux-image-generic set to manually installed. 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-24T17:17:58.427 INFO:teuthology.orchestra.run.trial040.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:17:58.448 INFO:teuthology.orchestra.run.trial040.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:17:58.450 DEBUG:teuthology.orchestra.run.trial040:> dpkg -s linux-image-generic 2026-02-24T17:17:58.455 INFO:teuthology.orchestra.run.trial094.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Package: linux-image-generic 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Status: install ok installed 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Priority: optional 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Section: kernel 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Installed-Size: 22 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Maintainer: Ubuntu Kernel Team 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Architecture: amd64 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Source: linux-meta 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Version: 5.15.0.171.160 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-24T17:17:58.501 INFO:teuthology.orchestra.run.trial040.stdout:Recommends: thermald 2026-02-24T17:17:58.502 INFO:teuthology.orchestra.run.trial040.stdout:Description: Generic Linux kernel image 2026-02-24T17:17:58.502 INFO:teuthology.orchestra.run.trial040.stdout: This package will always depend on the latest generic kernel image 2026-02-24T17:17:58.502 INFO:teuthology.orchestra.run.trial040.stdout: available. 2026-02-24T17:17:58.503 DEBUG:teuthology.orchestra.run.trial040:> mktemp 2026-02-24T17:17:58.538 INFO:teuthology.orchestra.run.trial094.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-24T17:17:58.548 INFO:teuthology.orchestra.run.trial040.stdout:/tmp/tmp.h4eN55kx9I 2026-02-24T17:17:58.548 DEBUG:teuthology.orchestra.run.trial040:> sudo cp /boot/grub/grub.cfg /tmp/tmp.h4eN55kx9I 2026-02-24T17:17:58.588 DEBUG:teuthology.orchestra.run.trial120:> dpkg -s linux-image-generic 2026-02-24T17:17:58.601 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0666 /tmp/tmp.h4eN55kx9I 2026-02-24T17:17:58.626 INFO:teuthology.orchestra.run.trial094.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-24T17:17:58.640 INFO:teuthology.orchestra.run.trial120.stdout:Package: linux-image-generic 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Status: install ok installed 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Priority: optional 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Section: kernel 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Installed-Size: 22 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Maintainer: Ubuntu Kernel Team 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Architecture: amd64 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Source: linux-meta 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Version: 5.15.0.171.160 2026-02-24T17:17:58.641 INFO:teuthology.orchestra.run.trial120.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-24T17:17:58.642 INFO:teuthology.orchestra.run.trial120.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-24T17:17:58.642 INFO:teuthology.orchestra.run.trial120.stdout:Recommends: thermald 2026-02-24T17:17:58.642 INFO:teuthology.orchestra.run.trial120.stdout:Description: Generic Linux kernel image 2026-02-24T17:17:58.642 INFO:teuthology.orchestra.run.trial120.stdout: This package will always depend on the latest generic kernel image 2026-02-24T17:17:58.642 INFO:teuthology.orchestra.run.trial120.stdout: available. 2026-02-24T17:17:58.642 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-170-generic Expected: 5.15.0-171-generic 2026-02-24T17:17:58.642 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T17:17:58.643 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T17:17:58.643 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-24T17:17:58.643 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial120.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T17:17:58.643 DEBUG:teuthology.orchestra.run.trial120:> sudo apt-get clean 2026-02-24T17:17:58.697 DEBUG:teuthology.orchestra.remote:trial040:/tmp/tmp.h4eN55kx9I is 9KB 2026-02-24T17:17:58.702 DEBUG:teuthology.orchestra.run.trial040:> rm -fr /tmp/tmp.h4eN55kx9I 2026-02-24T17:17:58.705 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-24T17:17:58.714 INFO:teuthology.orchestra.run.trial094.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-24T17:17:58.721 DEBUG:teuthology.orchestra.run.trial120:> sudo apt-get update 2026-02-24T17:17:58.759 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:17:58.759 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-24T17:17:58.759 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-24T17:17:58.814 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-171-generic 2026-02-24T17:17:58.814 DEBUG:teuthology.orchestra.run.trial040:> sudo update-grub 2026-02-24T17:17:58.904 INFO:teuthology.orchestra.run.trial120.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:17:58.909 INFO:teuthology.orchestra.run.trial120.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-24T17:17:58.919 INFO:teuthology.orchestra.run.trial120.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-24T17:17:58.929 INFO:teuthology.orchestra.run.trial120.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-24T17:17:59.058 INFO:teuthology.orchestra.run.trial040.stderr:Sourcing file `/etc/default/grub' 2026-02-24T17:17:59.078 INFO:teuthology.orchestra.run.trial040.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-24T17:17:59.079 INFO:teuthology.orchestra.run.trial040.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-24T17:17:59.081 INFO:teuthology.orchestra.run.trial040.stderr:Generating grub configuration file ... 2026-02-24T17:17:59.163 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-24T17:17:59.169 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:17:59.346 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-24T17:17:59.351 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-24T17:17:59.385 INFO:teuthology.orchestra.run.trial094.stdout:Reading package lists... 2026-02-24T17:17:59.392 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-24T17:17:59.397 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-24T17:17:59.400 DEBUG:teuthology.orchestra.run.trial094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-24T17:17:59.434 INFO:teuthology.orchestra.run.trial094.stdout:Reading package lists... 2026-02-24T17:17:59.467 INFO:teuthology.orchestra.run.trial040.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-24T17:17:59.467 INFO:teuthology.orchestra.run.trial040.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-24T17:17:59.468 INFO:teuthology.orchestra.run.trial040.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-24T17:17:59.469 INFO:teuthology.orchestra.run.trial040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T17:17:59.477 INFO:teuthology.orchestra.run.trial040.stderr:done 2026-02-24T17:17:59.478 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial040 2026-02-24T17:17:59.478 DEBUG:teuthology.orchestra.run.trial040:> sudo bash -c ' 2026-02-24T17:17:59.478 DEBUG:teuthology.orchestra.run.trial040:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T17:17:59.478 DEBUG:teuthology.orchestra.run.trial040:> ' 2026-02-24T17:17:59.544 INFO:teuthology.orchestra.run.trial094.stdout:Building dependency tree... 2026-02-24T17:17:59.544 INFO:teuthology.orchestra.run.trial094.stdout:Reading state information... 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout:linux-image-generic is already the newest version (5.15.0.171.160). 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout:linux-image-generic set to manually installed. 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-24T17:17:59.631 INFO:teuthology.orchestra.run.trial094.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:17:59.651 INFO:teuthology.orchestra.run.trial094.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:17:59.653 DEBUG:teuthology.orchestra.run.trial094:> dpkg -s linux-image-generic 2026-02-24T17:17:59.702 INFO:teuthology.orchestra.run.trial094.stdout:Package: linux-image-generic 2026-02-24T17:17:59.702 INFO:teuthology.orchestra.run.trial094.stdout:Status: install ok installed 2026-02-24T17:17:59.702 INFO:teuthology.orchestra.run.trial094.stdout:Priority: optional 2026-02-24T17:17:59.702 INFO:teuthology.orchestra.run.trial094.stdout:Section: kernel 2026-02-24T17:17:59.702 INFO:teuthology.orchestra.run.trial094.stdout:Installed-Size: 22 2026-02-24T17:17:59.703 INFO:teuthology.orchestra.run.trial094.stdout:Maintainer: Ubuntu Kernel Team 2026-02-24T17:17:59.703 INFO:teuthology.orchestra.run.trial094.stdout:Architecture: amd64 2026-02-24T17:17:59.703 INFO:teuthology.orchestra.run.trial094.stdout:Source: linux-meta 2026-02-24T17:17:59.703 INFO:teuthology.orchestra.run.trial094.stdout:Version: 5.15.0.171.160 2026-02-24T17:17:59.703 INFO:teuthology.orchestra.run.trial094.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-24T17:17:59.703 INFO:teuthology.orchestra.run.trial094.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-24T17:17:59.703 INFO:teuthology.orchestra.run.trial094.stdout:Recommends: thermald 2026-02-24T17:17:59.704 INFO:teuthology.orchestra.run.trial094.stdout:Description: Generic Linux kernel image 2026-02-24T17:17:59.704 INFO:teuthology.orchestra.run.trial094.stdout: This package will always depend on the latest generic kernel image 2026-02-24T17:17:59.704 INFO:teuthology.orchestra.run.trial094.stdout: available. 2026-02-24T17:17:59.705 DEBUG:teuthology.orchestra.run.trial094:> mktemp 2026-02-24T17:17:59.750 INFO:teuthology.orchestra.run.trial094.stdout:/tmp/tmp.Ht1ipVDnk5 2026-02-24T17:17:59.750 DEBUG:teuthology.orchestra.run.trial094:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ht1ipVDnk5 2026-02-24T17:17:59.754 INFO:teuthology.orchestra.run.trial120.stdout:Reading package lists... 2026-02-24T17:17:59.769 DEBUG:teuthology.orchestra.run.trial120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-24T17:17:59.801 INFO:teuthology.orchestra.run.trial120.stdout:Reading package lists... 2026-02-24T17:17:59.802 DEBUG:teuthology.orchestra.run.trial094:> sudo chmod 0666 /tmp/tmp.Ht1ipVDnk5 2026-02-24T17:17:59.900 DEBUG:teuthology.orchestra.remote:trial094:/tmp/tmp.Ht1ipVDnk5 is 9KB 2026-02-24T17:17:59.907 INFO:teuthology.orchestra.run.trial120.stdout:Building dependency tree... 2026-02-24T17:17:59.908 INFO:teuthology.orchestra.run.trial120.stdout:Reading state information... 2026-02-24T17:17:59.909 DEBUG:teuthology.orchestra.run.trial094:> rm -fr /tmp/tmp.Ht1ipVDnk5 2026-02-24T17:17:59.913 DEBUG:teuthology.orchestra.run.trial094:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-24T17:17:59.966 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:17:59.966 DEBUG:teuthology.orchestra.run.trial094:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-24T17:17:59.966 DEBUG:teuthology.orchestra.run.trial094:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-24T17:17:59.992 INFO:teuthology.orchestra.run.trial120.stdout:linux-image-generic is already the newest version (5.15.0.171.160). 2026-02-24T17:17:59.992 INFO:teuthology.orchestra.run.trial120.stdout:linux-image-generic set to manually installed. 2026-02-24T17:17:59.992 INFO:teuthology.orchestra.run.trial120.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:17:59.992 INFO:teuthology.orchestra.run.trial120.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:17:59.992 INFO:teuthology.orchestra.run.trial120.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-24T17:17:59.992 INFO:teuthology.orchestra.run.trial120.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-24T17:17:59.992 INFO:teuthology.orchestra.run.trial120.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-24T17:17:59.993 INFO:teuthology.orchestra.run.trial120.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-24T17:17:59.993 INFO:teuthology.orchestra.run.trial120.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:18:00.011 INFO:teuthology.orchestra.run.trial120.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:18:00.013 DEBUG:teuthology.orchestra.run.trial120:> dpkg -s linux-image-generic 2026-02-24T17:18:00.023 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-171-generic 2026-02-24T17:18:00.023 DEBUG:teuthology.orchestra.run.trial094:> sudo update-grub 2026-02-24T17:18:00.063 INFO:teuthology.orchestra.run.trial120.stdout:Package: linux-image-generic 2026-02-24T17:18:00.063 INFO:teuthology.orchestra.run.trial120.stdout:Status: install ok installed 2026-02-24T17:18:00.063 INFO:teuthology.orchestra.run.trial120.stdout:Priority: optional 2026-02-24T17:18:00.064 INFO:teuthology.orchestra.run.trial120.stdout:Section: kernel 2026-02-24T17:18:00.064 INFO:teuthology.orchestra.run.trial120.stdout:Installed-Size: 22 2026-02-24T17:18:00.064 INFO:teuthology.orchestra.run.trial120.stdout:Maintainer: Ubuntu Kernel Team 2026-02-24T17:18:00.064 INFO:teuthology.orchestra.run.trial120.stdout:Architecture: amd64 2026-02-24T17:18:00.064 INFO:teuthology.orchestra.run.trial120.stdout:Source: linux-meta 2026-02-24T17:18:00.064 INFO:teuthology.orchestra.run.trial120.stdout:Version: 5.15.0.171.160 2026-02-24T17:18:00.064 INFO:teuthology.orchestra.run.trial120.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-171), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-24T17:18:00.064 INFO:teuthology.orchestra.run.trial120.stdout:Depends: linux-image-5.15.0-171-generic, linux-modules-extra-5.15.0-171-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-24T17:18:00.065 INFO:teuthology.orchestra.run.trial120.stdout:Recommends: thermald 2026-02-24T17:18:00.065 INFO:teuthology.orchestra.run.trial120.stdout:Description: Generic Linux kernel image 2026-02-24T17:18:00.065 INFO:teuthology.orchestra.run.trial120.stdout: This package will always depend on the latest generic kernel image 2026-02-24T17:18:00.065 INFO:teuthology.orchestra.run.trial120.stdout: available. 2026-02-24T17:18:00.066 DEBUG:teuthology.orchestra.run.trial120:> mktemp 2026-02-24T17:18:00.110 INFO:teuthology.orchestra.run.trial120.stdout:/tmp/tmp.ZqOAhX9Vpd 2026-02-24T17:18:00.111 DEBUG:teuthology.orchestra.run.trial120:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZqOAhX9Vpd 2026-02-24T17:18:00.167 DEBUG:teuthology.orchestra.run.trial120:> sudo chmod 0666 /tmp/tmp.ZqOAhX9Vpd 2026-02-24T17:18:00.260 INFO:teuthology.orchestra.run.trial094.stderr:Sourcing file `/etc/default/grub' 2026-02-24T17:18:00.265 DEBUG:teuthology.orchestra.remote:trial120:/tmp/tmp.ZqOAhX9Vpd is 9KB 2026-02-24T17:18:00.274 DEBUG:teuthology.orchestra.run.trial120:> rm -fr /tmp/tmp.ZqOAhX9Vpd 2026-02-24T17:18:00.278 DEBUG:teuthology.orchestra.run.trial120:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-24T17:18:00.279 INFO:teuthology.orchestra.run.trial094.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-24T17:18:00.280 INFO:teuthology.orchestra.run.trial094.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-24T17:18:00.282 INFO:teuthology.orchestra.run.trial094.stderr:Generating grub configuration file ... 2026-02-24T17:18:00.326 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:18:00.326 DEBUG:teuthology.orchestra.run.trial120:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-24T17:18:00.326 DEBUG:teuthology.orchestra.run.trial120:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-24T17:18:00.368 INFO:teuthology.orchestra.run.trial094.stderr:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-24T17:18:00.373 INFO:teuthology.orchestra.run.trial094.stderr:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:18:00.384 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-171-generic 2026-02-24T17:18:00.384 DEBUG:teuthology.orchestra.run.trial120:> sudo update-grub 2026-02-24T17:18:00.549 INFO:teuthology.orchestra.run.trial094.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-24T17:18:00.554 INFO:teuthology.orchestra.run.trial094.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-24T17:18:00.595 INFO:teuthology.orchestra.run.trial094.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-24T17:18:00.600 INFO:teuthology.orchestra.run.trial094.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-24T17:18:00.629 INFO:teuthology.orchestra.run.trial120.stderr:Sourcing file `/etc/default/grub' 2026-02-24T17:18:00.648 INFO:teuthology.orchestra.run.trial120.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-24T17:18:00.649 INFO:teuthology.orchestra.run.trial120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-24T17:18:00.651 INFO:teuthology.orchestra.run.trial120.stderr:Generating grub configuration file ... 2026-02-24T17:18:00.672 INFO:teuthology.orchestra.run.trial094.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-24T17:18:00.672 INFO:teuthology.orchestra.run.trial094.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-24T17:18:00.673 INFO:teuthology.orchestra.run.trial094.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-24T17:18:00.675 INFO:teuthology.orchestra.run.trial094.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T17:18:00.683 INFO:teuthology.orchestra.run.trial094.stderr:done 2026-02-24T17:18:00.684 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial094 2026-02-24T17:18:00.685 DEBUG:teuthology.orchestra.run.trial094:> sudo bash -c ' 2026-02-24T17:18:00.685 DEBUG:teuthology.orchestra.run.trial094:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T17:18:00.685 DEBUG:teuthology.orchestra.run.trial094:> ' 2026-02-24T17:18:00.738 INFO:teuthology.orchestra.run.trial120.stderr:Found linux image: /boot/vmlinuz-5.15.0-171-generic 2026-02-24T17:18:00.744 INFO:teuthology.orchestra.run.trial120.stderr:Found initrd image: /boot/initrd.img-5.15.0-171-generic 2026-02-24T17:18:00.921 INFO:teuthology.orchestra.run.trial120.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-24T17:18:00.926 INFO:teuthology.orchestra.run.trial120.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-24T17:18:00.969 INFO:teuthology.orchestra.run.trial120.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-24T17:18:00.974 INFO:teuthology.orchestra.run.trial120.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-24T17:18:01.048 INFO:teuthology.orchestra.run.trial120.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-24T17:18:01.048 INFO:teuthology.orchestra.run.trial120.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-24T17:18:01.048 INFO:teuthology.orchestra.run.trial120.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-24T17:18:01.051 INFO:teuthology.orchestra.run.trial120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T17:18:01.059 INFO:teuthology.orchestra.run.trial120.stderr:done 2026-02-24T17:18:01.060 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial120 2026-02-24T17:18:01.061 DEBUG:teuthology.orchestra.run.trial120:> sudo bash -c ' 2026-02-24T17:18:01.061 DEBUG:teuthology.orchestra.run.trial120:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T17:18:01.061 DEBUG:teuthology.orchestra.run.trial120:> ' 2026-02-24T17:18:27.672 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-24T17:18:27.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-24T17:18:27.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:18:29.480 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T17:18:29.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-24T17:18:29.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:18:30.687 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-24T17:18:30.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial094.front.sepia.ceph.com' 2026-02-24T17:18:30.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:18:31.064 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-24T17:18:31.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial120.front.sepia.ceph.com' 2026-02-24T17:18:31.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:19:27.730 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T17:19:29.486 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T17:19:30.691 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T17:19:31.067 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T17:19:36.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-24T17:19:36.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:19:36.855 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-24T17:19:37.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-24T17:19:37.246 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.15.0-171-generic"... 2026-02-24T17:19:37.246 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-24T17:19:37.291 INFO:teuthology.orchestra.run.trial109.stdout:5.15.0-171-generic 2026-02-24T17:19:37.291 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-171-generic vs 5.15.0-171-generic 2026-02-24T17:19:37.291 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T17:19:37.291 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-24T17:19:38.292 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-24T17:19:38.292 DEBUG:teuthology.orchestra.run.trial109:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T17:19:38.304 INFO:teuthology.orchestra.run.trial109.stdout:ttyS1 2026-02-24T17:19:38.326 DEBUG:teuthology.parallel:result is None 2026-02-24T17:19:38.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-24T17:19:38.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:19:38.613 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-24T17:19:39.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-24T17:19:39.003 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-171-generic"... 2026-02-24T17:19:39.003 DEBUG:teuthology.orchestra.run.trial040:> uname -r 2026-02-24T17:19:39.051 INFO:teuthology.orchestra.run.trial040.stdout:5.15.0-171-generic 2026-02-24T17:19:39.051 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-171-generic vs 5.15.0-171-generic 2026-02-24T17:19:39.051 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T17:19:39.051 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-24T17:19:39.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial094.front.sepia.ceph.com' 2026-02-24T17:19:39.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:19:39.792 DEBUG:teuthology.orchestra.run.trial094:> true 2026-02-24T17:19:40.052 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-24T17:19:40.052 DEBUG:teuthology.orchestra.run.trial040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T17:19:40.064 INFO:teuthology.orchestra.run.trial040.stdout:ttyS1 2026-02-24T17:19:40.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial120.front.sepia.ceph.com' 2026-02-24T17:19:40.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:19:40.082 DEBUG:teuthology.parallel:result is None 2026-02-24T17:19:40.186 DEBUG:teuthology.orchestra.run.trial120:> true 2026-02-24T17:19:40.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial094.front.sepia.ceph.com' 2026-02-24T17:19:40.189 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-171-generic"... 2026-02-24T17:19:40.189 DEBUG:teuthology.orchestra.run.trial094:> uname -r 2026-02-24T17:19:40.235 INFO:teuthology.orchestra.run.trial094.stdout:5.15.0-171-generic 2026-02-24T17:19:40.235 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-171-generic vs 5.15.0-171-generic 2026-02-24T17:19:40.235 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T17:19:40.235 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-24T17:19:40.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial120.front.sepia.ceph.com' 2026-02-24T17:19:40.584 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-171-generic"... 2026-02-24T17:19:40.584 DEBUG:teuthology.orchestra.run.trial120:> uname -r 2026-02-24T17:19:40.631 INFO:teuthology.orchestra.run.trial120.stdout:5.15.0-171-generic 2026-02-24T17:19:40.631 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-171-generic vs 5.15.0-171-generic 2026-02-24T17:19:40.631 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T17:19:40.632 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-24T17:19:41.236 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-24T17:19:41.237 DEBUG:teuthology.orchestra.run.trial094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T17:19:41.250 INFO:teuthology.orchestra.run.trial094.stdout:ttyS1 2026-02-24T17:19:41.274 DEBUG:teuthology.parallel:result is None 2026-02-24T17:19:41.633 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-24T17:19:41.633 DEBUG:teuthology.orchestra.run.trial120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T17:19:41.646 INFO:teuthology.orchestra.run.trial120.stdout:ttyS1 2026-02-24T17:19:41.669 DEBUG:teuthology.parallel:result is None 2026-02-24T17:19:41.669 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T17:19:41.680 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T17:19:41.680 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T17:19:41.682 DEBUG:teuthology.orchestra.run.trial094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T17:19:41.683 DEBUG:teuthology.orchestra.run.trial109:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T17:19:41.684 DEBUG:teuthology.orchestra.run.trial120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T17:19:41.714 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T17:19:41.725 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T17:19:41.737 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T17:19:41.737 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T17:19:41.739 DEBUG:teuthology.orchestra.run.trial094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T17:19:41.740 DEBUG:teuthology.orchestra.run.trial109:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T17:19:41.741 DEBUG:teuthology.orchestra.run.trial120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T17:19:41.764 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T17:19:41.774 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T17:19:41.774 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T17:19:41.785 DEBUG:teuthology.orchestra.run.trial094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T17:19:41.790 DEBUG:teuthology.orchestra.run.trial109:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T17:19:41.792 DEBUG:teuthology.orchestra.run.trial120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T17:19:41.793 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T17:19:41.797 INFO:teuthology.orchestra.run.trial094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T17:19:41.799 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T17:19:41.800 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T17:19:41.803 INFO:teuthology.orchestra.run.trial094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T17:19:41.806 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T17:19:41.808 INFO:teuthology.orchestra.run.trial120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T17:19:41.814 INFO:teuthology.orchestra.run.trial120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T17:19:41.815 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T17:19:41.825 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T17:19:41.825 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T17:19:41.845 DEBUG:teuthology.orchestra.run.trial094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T17:19:41.849 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T17:19:41.850 DEBUG:teuthology.orchestra.run.trial120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T17:19:41.863 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T17:19:41.878 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T17:19:41.878 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T17:19:41.894 DEBUG:teuthology.orchestra.run.trial094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T17:19:41.897 DEBUG:teuthology.orchestra.run.trial109:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T17:19:41.901 DEBUG:teuthology.orchestra.run.trial120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T17:19:41.907 DEBUG:teuthology.orchestra.run.trial040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T17:19:41.940 DEBUG:teuthology.orchestra.run.trial040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T17:19:41.984 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:19:41.984 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T17:19:42.034 DEBUG:teuthology.orchestra.run.trial094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T17:19:42.039 DEBUG:teuthology.orchestra.run.trial094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T17:19:42.083 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:19:42.083 DEBUG:teuthology.orchestra.run.trial094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T17:19:42.132 DEBUG:teuthology.orchestra.run.trial109:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T17:19:42.136 DEBUG:teuthology.orchestra.run.trial109:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T17:19:42.185 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:19:42.185 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T17:19:42.237 DEBUG:teuthology.orchestra.run.trial120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T17:19:42.241 DEBUG:teuthology.orchestra.run.trial120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T17:19:42.287 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:19:42.288 DEBUG:teuthology.orchestra.run.trial120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T17:19:42.341 DEBUG:teuthology.orchestra.run.trial040:> sudo service rsyslog restart 2026-02-24T17:19:42.342 DEBUG:teuthology.orchestra.run.trial094:> sudo service rsyslog restart 2026-02-24T17:19:42.343 DEBUG:teuthology.orchestra.run.trial109:> sudo service rsyslog restart 2026-02-24T17:19:42.344 DEBUG:teuthology.orchestra.run.trial120:> sudo service rsyslog restart 2026-02-24T17:19:42.400 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T17:19:42.411 INFO:teuthology.task.internal:Starting timer... 2026-02-24T17:19:42.411 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T17:19:42.427 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T17:19:42.440 DEBUG:teuthology.task.selinux:Excluding trial040: OS 'ubuntu' does not support SELinux 2026-02-24T17:19:42.440 DEBUG:teuthology.task.selinux:Excluding trial094: OS 'ubuntu' does not support SELinux 2026-02-24T17:19:42.440 DEBUG:teuthology.task.selinux:Excluding trial109: OS 'ubuntu' does not support SELinux 2026-02-24T17:19:42.440 DEBUG:teuthology.task.selinux:Excluding trial120: OS 'ubuntu' does not support SELinux 2026-02-24T17:19:42.441 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T17:19:42.441 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-24T17:19:42.441 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T17:19:42.441 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T17:19:42.453 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-24T17:19:42.455 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-24T17:19:42.564 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T17:19:42.575 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T17:19:42.575 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial040.front.sepia.ceph.com,trial094.front.sepia.ceph.com,trial109.front.sepia.ceph.com,trial120.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T17:22:07.327 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial040.front.sepia.ceph.com'), Remote(name='ubuntu@trial094.front.sepia.ceph.com'), Remote(name='ubuntu@trial109.front.sepia.ceph.com'), Remote(name='ubuntu@trial120.front.sepia.ceph.com')] 2026-02-24T17:22:07.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-24T17:22:07.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:22:07.441 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-24T17:22:07.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-24T17:22:07.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial094.front.sepia.ceph.com' 2026-02-24T17:22:07.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:22:07.792 DEBUG:teuthology.orchestra.run.trial094:> true 2026-02-24T17:22:08.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial094.front.sepia.ceph.com' 2026-02-24T17:22:08.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-24T17:22:08.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:22:08.145 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-24T17:22:08.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-24T17:22:08.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial120.front.sepia.ceph.com' 2026-02-24T17:22:08.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T17:22:08.485 DEBUG:teuthology.orchestra.run.trial120:> true 2026-02-24T17:22:08.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial120.front.sepia.ceph.com' 2026-02-24T17:22:08.730 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T17:22:08.751 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T17:22:08.752 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T17:22:08.752 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T17:22:08.755 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T17:22:08.755 DEBUG:teuthology.orchestra.run.trial094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T17:22:08.758 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T17:22:08.758 DEBUG:teuthology.orchestra.run.trial109:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T17:22:08.760 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T17:22:08.760 DEBUG:teuthology.orchestra.run.trial120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T17:22:08.772 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-24T17:22:08.772 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Command line: ntpd -gq 2026-02-24T17:22:08.772 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: ---------------------------------------------------- 2026-02-24T17:22:08.772 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: ntp-4 is maintained by Network Time Foundation, 2026-02-24T17:22:08.772 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-24T17:22:08.772 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: corporation. Support and training for ntp-4 are 2026-02-24T17:22:08.772 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: available at https://www.nwtime.org/support 2026-02-24T17:22:08.772 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: ---------------------------------------------------- 2026-02-24T17:22:08.773 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: proto: precision = 0.020 usec (-25) 2026-02-24T17:22:08.773 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: basedate set to 2022-02-04 2026-02-24T17:22:08.773 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: gps base set to 2022-02-06 (week 2196) 2026-02-24T17:22:08.773 INFO:teuthology.orchestra.run.trial040.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-24T17:22:08.774 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-24T17:22:08.774 INFO:teuthology.orchestra.run.trial040.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-24T17:22:08.775 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: restrict ::: KOD does nothing without LIMITED. 2026-02-24T17:22:08.775 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Listen and drop on 0 v6wildcard [::]:123 2026-02-24T17:22:08.775 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-24T17:22:08.775 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Listen normally on 2 lo 127.0.0.1:123 2026-02-24T17:22:08.775 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Listen normally on 3 enp1s0f0 10.20.193.40:123 2026-02-24T17:22:08.775 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Listen normally on 4 lo [::1]:123 2026-02-24T17:22:08.775 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5e28%2]:123 2026-02-24T17:22:08.776 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:09 ntpd[8804]: Listening on routing socket on fd #22 for interface updates 2026-02-24T17:22:08.777 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-24T17:22:08.777 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Command line: ntpd -gq 2026-02-24T17:22:08.777 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: ---------------------------------------------------- 2026-02-24T17:22:08.777 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: ntp-4 is maintained by Network Time Foundation, 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: corporation. Support and training for ntp-4 are 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: available at https://www.nwtime.org/support 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: ---------------------------------------------------- 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: proto: precision = 0.020 usec (-25) 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: basedate set to 2022-02-04 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: gps base set to 2022-02-06 (week 2196) 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-24T17:22:08.778 INFO:teuthology.orchestra.run.trial094.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-24T17:22:08.779 INFO:teuthology.orchestra.run.trial094.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-24T17:22:08.780 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: restrict ::: KOD does nothing without LIMITED. 2026-02-24T17:22:08.780 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Listen and drop on 0 v6wildcard [::]:123 2026-02-24T17:22:08.780 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-24T17:22:08.780 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Listen normally on 2 lo 127.0.0.1:123 2026-02-24T17:22:08.780 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Listen normally on 3 enp1s0f0 10.20.193.94:123 2026-02-24T17:22:08.780 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Listen normally on 4 lo [::1]:123 2026-02-24T17:22:08.780 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5dea%2]:123 2026-02-24T17:22:08.780 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:09 ntpd[8799]: Listening on routing socket on fd #22 for interface updates 2026-02-24T17:22:08.782 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Command line: ntpd -gq 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: ---------------------------------------------------- 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: ntp-4 is maintained by Network Time Foundation, 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: corporation. Support and training for ntp-4 are 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: available at https://www.nwtime.org/support 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: ---------------------------------------------------- 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: proto: precision = 0.030 usec (-25) 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: basedate set to 2022-02-04 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: gps base set to 2022-02-06 (week 2196) 2026-02-24T17:22:08.783 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-24T17:22:08.784 INFO:teuthology.orchestra.run.trial109.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-24T17:22:08.784 INFO:teuthology.orchestra.run.trial109.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-24T17:22:08.785 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: restrict ::: KOD does nothing without LIMITED. 2026-02-24T17:22:08.785 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Listen and drop on 0 v6wildcard [::]:123 2026-02-24T17:22:08.785 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-24T17:22:08.785 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Listen normally on 2 lo 127.0.0.1:123 2026-02-24T17:22:08.785 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Listen normally on 3 enp1s0f0 10.20.193.109:123 2026-02-24T17:22:08.786 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Listen normally on 4 lo [::1]:123 2026-02-24T17:22:08.786 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:61a2%2]:123 2026-02-24T17:22:08.786 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:09 ntpd[8816]: Listening on routing socket on fd #22 for interface updates 2026-02-24T17:22:08.794 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-24T17:22:08.794 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Command line: ntpd -gq 2026-02-24T17:22:08.794 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: ---------------------------------------------------- 2026-02-24T17:22:08.794 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: ntp-4 is maintained by Network Time Foundation, 2026-02-24T17:22:08.794 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-24T17:22:08.794 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: corporation. Support and training for ntp-4 are 2026-02-24T17:22:08.795 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: available at https://www.nwtime.org/support 2026-02-24T17:22:08.795 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: ---------------------------------------------------- 2026-02-24T17:22:08.795 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: proto: precision = 0.020 usec (-25) 2026-02-24T17:22:08.795 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: basedate set to 2022-02-04 2026-02-24T17:22:08.795 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: gps base set to 2022-02-06 (week 2196) 2026-02-24T17:22:08.795 INFO:teuthology.orchestra.run.trial120.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-24T17:22:08.796 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-24T17:22:08.796 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: restrict ::: KOD does nothing without LIMITED. 2026-02-24T17:22:08.796 INFO:teuthology.orchestra.run.trial120.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-24T17:22:08.797 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Listen and drop on 0 v6wildcard [::]:123 2026-02-24T17:22:08.797 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-24T17:22:08.797 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Listen normally on 2 lo 127.0.0.1:123 2026-02-24T17:22:08.797 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Listen normally on 3 enp1s0f0 10.20.193.120:123 2026-02-24T17:22:08.798 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Listen normally on 4 lo [::1]:123 2026-02-24T17:22:08.798 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6146%2]:123 2026-02-24T17:22:08.798 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:08 ntpd[8829]: Listening on routing socket on fd #22 for interface updates 2026-02-24T17:22:09.771 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:10 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.771 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:10 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:10 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:10 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:10 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:09.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:10 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:09.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:10 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:10 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.793 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:09 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.793 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:09 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.794 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:09 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.794 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:09 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:09.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:09.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:09.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:10 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:09.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:10 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:10 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.847 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:10 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:09.847 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:10 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:09.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:09 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:09.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:09 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:09.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:09 ntpd[8829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:09.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:09 ntpd[8829]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:10.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:11 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:10.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:11 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:10.789 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:11 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:10.789 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:11 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:10.789 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:11 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:10.789 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:11 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:11.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:11.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:11.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:11.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:12 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:11.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:12 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:12 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.793 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:11 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.794 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:11 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:11.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:11.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:11.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:12 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:11.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:12 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:12 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:12 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:11.847 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:12 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:11.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:11 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:11.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:11 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:11.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:11 ntpd[8829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:11.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:11 ntpd[8829]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:12.771 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:13 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:12.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:13 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:12.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:12.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:12.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:12.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:12.786 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:12.786 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:12.786 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:12.786 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:12.808 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:13 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:12.808 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:13 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:12.808 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:13 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:12.809 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:13 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:12.849 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:12.849 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:12.850 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:12.850 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:13 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.771 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.771 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.775 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.775 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.775 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.776 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.778 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.778 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.778 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.778 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.793 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.793 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.793 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.793 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.796 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.797 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.797 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.797 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.802 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.802 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.802 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.802 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.816 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.816 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.816 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.816 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.836 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.836 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.836 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.836 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:14 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.844 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.844 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.845 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:14 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.851 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.851 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.851 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.852 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:14 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:13.863 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:13.863 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:13.863 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:13.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:13 ntpd[8829]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:14.771 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:15 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:14.771 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:15 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:14.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:14.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:14.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:14.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:14.786 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:14.786 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:14.786 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:14.786 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:14.808 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:15 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:14.808 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:15 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:14.808 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:15 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:14.808 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:15 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:14.850 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:14.850 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:14.850 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:14.850 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:15.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.772 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.774 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:15.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:16 ntpd[8804]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:15.775 INFO:teuthology.orchestra.run.trial040.stdout:24 Feb 17:22:15 ntpd[8804]: ntpd: time set -0.502153 s 2026-02-24T17:22:15.775 INFO:teuthology.orchestra.run.trial040.stdout:ntpd: time set -0.502153s 2026-02-24T17:22:15.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:15 ntpd[8804]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-24T17:22:15.775 INFO:teuthology.orchestra.run.trial040.stderr:24 Feb 17:22:15 ntpd[8804]: can't open /var/log/ntpstats/loopstats.20260224: Permission denied 2026-02-24T17:22:15.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.777 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.793 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.794 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.794 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.794 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.798 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.798 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.798 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:15.798 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:15.801 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.802 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.802 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:15.802 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:15.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:15.804 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:16 ntpd[8799]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:15.805 INFO:teuthology.orchestra.run.trial094.stdout:24 Feb 17:22:15 ntpd[8799]: ntpd: time set -0.502836 s 2026-02-24T17:22:15.805 INFO:teuthology.orchestra.run.trial094.stdout:ntpd: time set -0.502836s 2026-02-24T17:22:15.805 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:15 ntpd[8799]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-24T17:22:15.805 INFO:teuthology.orchestra.run.trial094.stderr:24 Feb 17:22:15 ntpd[8799]: can't open /var/log/ntpstats/loopstats.20260224: Permission denied 2026-02-24T17:22:15.809 INFO:teuthology.orchestra.run.trial040.stdout: remote refid st t when poll reach delay offset jitter 2026-02-24T17:22:15.809 INFO:teuthology.orchestra.run.trial040.stdout:============================================================================== 2026-02-24T17:22:15.809 INFO:teuthology.orchestra.run.trial040.stdout: 139-177-202-26. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:15.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:15.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:16 ntpd[8816]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:15.846 INFO:teuthology.orchestra.run.trial109.stdout:24 Feb 17:22:15 ntpd[8816]: ntpd: time set -0.426369 s 2026-02-24T17:22:15.846 INFO:teuthology.orchestra.run.trial109.stdout:ntpd: time set -0.426369s 2026-02-24T17:22:15.846 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-24T17:22:15.847 INFO:teuthology.orchestra.run.trial109.stderr:24 Feb 17:22:15 ntpd[8816]: can't open /var/log/ntpstats/loopstats.20260224: Permission denied 2026-02-24T17:22:15.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-24T17:22:15.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: can't open /var/log/ntpstats/rawstats.20260224: Permission denied 2026-02-24T17:22:15.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-24T17:22:15.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: can't open /var/log/ntpstats/peerstats.20260224: Permission denied 2026-02-24T17:22:15.864 INFO:teuthology.orchestra.run.trial120.stdout:24 Feb 17:22:15 ntpd[8829]: ntpd: time set -0.029174 s 2026-02-24T17:22:15.864 INFO:teuthology.orchestra.run.trial120.stdout:ntpd: time set -0.029174s 2026-02-24T17:22:15.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-24T17:22:15.864 INFO:teuthology.orchestra.run.trial120.stderr:24 Feb 17:22:15 ntpd[8829]: can't open /var/log/ntpstats/loopstats.20260224: Permission denied 2026-02-24T17:22:15.909 INFO:teuthology.orchestra.run.trial109.stdout: remote refid st t when poll reach delay offset jitter 2026-02-24T17:22:15.910 INFO:teuthology.orchestra.run.trial109.stdout:============================================================================== 2026-02-24T17:22:15.910 INFO:teuthology.orchestra.run.trial109.stdout: 23.155.72.147 ( .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:15.910 INFO:teuthology.orchestra.run.trial109.stdout: frumentum-zeus. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:15.910 INFO:teuthology.orchestra.run.trial109.stdout: white.web-ster. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:15.910 INFO:teuthology.orchestra.run.trial109.stdout: time4.lshiy.com .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:15.927 INFO:teuthology.orchestra.run.trial120.stdout: remote refid st t when poll reach delay offset jitter 2026-02-24T17:22:15.927 INFO:teuthology.orchestra.run.trial120.stdout:============================================================================== 2026-02-24T17:22:15.927 INFO:teuthology.orchestra.run.trial120.stdout: 23.186.168.132 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:15.927 INFO:teuthology.orchestra.run.trial120.stdout: sushi.ruselabs. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:15.927 INFO:teuthology.orchestra.run.trial120.stdout: 172-238-164-57. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:15.927 INFO:teuthology.orchestra.run.trial120.stdout: 138.89.14.60 (p .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:16.008 INFO:teuthology.orchestra.run.trial094.stdout: remote refid st t when poll reach delay offset jitter 2026-02-24T17:22:16.008 INFO:teuthology.orchestra.run.trial094.stdout:============================================================================== 2026-02-24T17:22:16.008 INFO:teuthology.orchestra.run.trial094.stdout: 139-177-202-26. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:16.008 INFO:teuthology.orchestra.run.trial094.stdout: 170-187-147-56. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:16.008 INFO:teuthology.orchestra.run.trial094.stdout: 69.9.131.124 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:16.008 INFO:teuthology.orchestra.run.trial094.stdout: time.cloudflare .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-24T17:22:16.009 INFO:teuthology.run_tasks:Running task install... 2026-02-24T17:22:16.022 DEBUG:teuthology.task.install:project ceph 2026-02-24T17:22:16.022 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '618c318a7a0b287ab5aeff207b7bf1d73ef45044'}} 2026-02-24T17:22:16.023 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '618c318a7a0b287ab5aeff207b7bf1d73ef45044'} 2026-02-24T17:22:16.023 INFO:teuthology.task.install:Using flavor: default 2026-02-24T17:22:16.029 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T17:22:16.029 INFO:teuthology.task.install:extra packages: [] 2026-02-24T17:22:16.029 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-key list | grep Ceph 2026-02-24T17:22:16.030 DEBUG:teuthology.orchestra.run.trial094:> sudo apt-key list | grep Ceph 2026-02-24T17:22:16.030 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-key list | grep Ceph 2026-02-24T17:22:16.030 DEBUG:teuthology.orchestra.run.trial120:> sudo apt-key list | grep Ceph 2026-02-24T17:22:16.073 INFO:teuthology.orchestra.run.trial040.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-24T17:22:16.078 INFO:teuthology.orchestra.run.trial120.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-24T17:22:16.079 INFO:teuthology.orchestra.run.trial109.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-24T17:22:16.097 INFO:teuthology.orchestra.run.trial040.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-24T17:22:16.097 INFO:teuthology.orchestra.run.trial040.stdout:uid [ unknown] Ceph.com (release key) 2026-02-24T17:22:16.098 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-24T17:22:16.098 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:22:16.102 INFO:teuthology.orchestra.run.trial094.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-24T17:22:16.106 INFO:teuthology.orchestra.run.trial120.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-24T17:22:16.106 INFO:teuthology.orchestra.run.trial120.stdout:uid [ unknown] Ceph.com (release key) 2026-02-24T17:22:16.107 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-24T17:22:16.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:22:16.112 INFO:teuthology.orchestra.run.trial109.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-24T17:22:16.112 INFO:teuthology.orchestra.run.trial109.stdout:uid [ unknown] Ceph.com (release key) 2026-02-24T17:22:16.113 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-24T17:22:16.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:22:16.269 INFO:teuthology.orchestra.run.trial094.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-24T17:22:16.269 INFO:teuthology.orchestra.run.trial094.stdout:uid [ unknown] Ceph.com (release key) 2026-02-24T17:22:16.269 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-24T17:22:16.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:22:16.362 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default/ 2026-02-24T17:22:16.363 INFO:teuthology.task.install.deb:Package version is 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:22:16.376 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default/ 2026-02-24T17:22:16.376 INFO:teuthology.task.install.deb:Package version is 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:22:16.377 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default/ 2026-02-24T17:22:16.377 INFO:teuthology.task.install.deb:Package version is 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:22:16.409 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default/ 2026-02-24T17:22:16.409 INFO:teuthology.task.install.deb:Package version is 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:22:16.787 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:22:16.787 DEBUG:teuthology.orchestra.run.trial120:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-24T17:22:16.790 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:22:16.790 DEBUG:teuthology.orchestra.run.trial094:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-24T17:22:16.799 DEBUG:teuthology.orchestra.run.trial120:> sudo apt-get update 2026-02-24T17:22:16.801 DEBUG:teuthology.orchestra.run.trial094:> sudo apt-get update 2026-02-24T17:22:16.807 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:22:16.807 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-24T17:22:16.817 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get update 2026-02-24T17:22:16.857 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:22:16.857 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-24T17:22:16.867 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get update 2026-02-24T17:22:17.186 INFO:teuthology.orchestra.run.trial120.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy InRelease 2026-02-24T17:22:17.187 INFO:teuthology.orchestra.run.trial094.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy InRelease 2026-02-24T17:22:17.189 INFO:teuthology.orchestra.run.trial109.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy InRelease 2026-02-24T17:22:17.243 INFO:teuthology.orchestra.run.trial040.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy InRelease 2026-02-24T17:22:17.256 INFO:teuthology.orchestra.run.trial120.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-24T17:22:17.256 INFO:teuthology.orchestra.run.trial094.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-24T17:22:17.259 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-24T17:22:17.303 INFO:teuthology.orchestra.run.trial040.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:22:17.309 INFO:teuthology.orchestra.run.trial094.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:22:17.313 INFO:teuthology.orchestra.run.trial040.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-24T17:22:17.319 INFO:teuthology.orchestra.run.trial120.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:22:17.325 INFO:teuthology.orchestra.run.trial120.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-24T17:22:17.327 INFO:teuthology.orchestra.run.trial094.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-24T17:22:17.328 INFO:teuthology.orchestra.run.trial109.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-24T17:22:17.329 INFO:teuthology.orchestra.run.trial109.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-24T17:22:17.371 INFO:teuthology.orchestra.run.trial040.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-24T17:22:17.382 INFO:teuthology.orchestra.run.trial040.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-24T17:22:17.391 INFO:teuthology.orchestra.run.trial094.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-24T17:22:17.395 INFO:teuthology.orchestra.run.trial120.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-24T17:22:17.396 INFO:teuthology.orchestra.run.trial094.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-24T17:22:17.400 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-24T17:22:17.404 INFO:teuthology.orchestra.run.trial120.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-24T17:22:17.415 INFO:teuthology.orchestra.run.trial109.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-24T17:22:17.443 INFO:teuthology.orchestra.run.trial040.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-24T17:22:17.454 INFO:teuthology.orchestra.run.trial040.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-24T17:22:17.480 INFO:teuthology.orchestra.run.trial094.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-24T17:22:17.495 INFO:teuthology.orchestra.run.trial120.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-24T17:22:17.507 INFO:teuthology.orchestra.run.trial109.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-24T17:22:17.516 INFO:teuthology.orchestra.run.trial040.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-24T17:22:17.568 INFO:teuthology.orchestra.run.trial094.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-24T17:22:17.586 INFO:teuthology.orchestra.run.trial120.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-24T17:22:17.598 INFO:teuthology.orchestra.run.trial109.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-24T17:22:17.660 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 26.9 kB in 1s (42.5 kB/s) 2026-02-24T17:22:17.710 INFO:teuthology.orchestra.run.trial094.stdout:Fetched 26.9 kB in 1s (36.0 kB/s) 2026-02-24T17:22:17.731 INFO:teuthology.orchestra.run.trial120.stdout:Fetched 26.9 kB in 1s (34.9 kB/s) 2026-02-24T17:22:17.743 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 26.9 kB in 1s (35.2 kB/s) 2026-02-24T17:22:18.193 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-24T17:22:18.206 DEBUG:teuthology.orchestra.run.trial040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5507-g618c318a-1jammy cephadm=20.3.0-5507-g618c318a-1jammy ceph-mds=20.3.0-5507-g618c318a-1jammy ceph-mgr=20.3.0-5507-g618c318a-1jammy ceph-osd=20.3.0-5507-g618c318a-1jammy ceph-osd-classic=20.3.0-5507-g618c318a-1jammy ceph-common=20.3.0-5507-g618c318a-1jammy ceph-fuse=20.3.0-5507-g618c318a-1jammy ceph-test=20.3.0-5507-g618c318a-1jammy ceph-volume=20.3.0-5507-g618c318a-1jammy radosgw=20.3.0-5507-g618c318a-1jammy python3-rados=20.3.0-5507-g618c318a-1jammy python3-rgw=20.3.0-5507-g618c318a-1jammy python3-cephfs=20.3.0-5507-g618c318a-1jammy python3-rbd=20.3.0-5507-g618c318a-1jammy libcephfs2=20.3.0-5507-g618c318a-1jammy libcephfs-dev=20.3.0-5507-g618c318a-1jammy librados2=20.3.0-5507-g618c318a-1jammy librbd1=20.3.0-5507-g618c318a-1jammy rbd-fuse=20.3.0-5507-g618c318a-1jammy 2026-02-24T17:22:18.249 INFO:teuthology.orchestra.run.trial094.stdout:Reading package lists... 2026-02-24T17:22:18.250 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-24T17:22:18.256 INFO:teuthology.orchestra.run.trial120.stdout:Reading package lists... 2026-02-24T17:22:18.261 DEBUG:teuthology.orchestra.run.trial094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5507-g618c318a-1jammy cephadm=20.3.0-5507-g618c318a-1jammy ceph-mds=20.3.0-5507-g618c318a-1jammy ceph-mgr=20.3.0-5507-g618c318a-1jammy ceph-osd=20.3.0-5507-g618c318a-1jammy ceph-osd-classic=20.3.0-5507-g618c318a-1jammy ceph-common=20.3.0-5507-g618c318a-1jammy ceph-fuse=20.3.0-5507-g618c318a-1jammy ceph-test=20.3.0-5507-g618c318a-1jammy ceph-volume=20.3.0-5507-g618c318a-1jammy radosgw=20.3.0-5507-g618c318a-1jammy python3-rados=20.3.0-5507-g618c318a-1jammy python3-rgw=20.3.0-5507-g618c318a-1jammy python3-cephfs=20.3.0-5507-g618c318a-1jammy python3-rbd=20.3.0-5507-g618c318a-1jammy libcephfs2=20.3.0-5507-g618c318a-1jammy libcephfs-dev=20.3.0-5507-g618c318a-1jammy librados2=20.3.0-5507-g618c318a-1jammy librbd1=20.3.0-5507-g618c318a-1jammy rbd-fuse=20.3.0-5507-g618c318a-1jammy 2026-02-24T17:22:18.269 DEBUG:teuthology.orchestra.run.trial120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5507-g618c318a-1jammy cephadm=20.3.0-5507-g618c318a-1jammy ceph-mds=20.3.0-5507-g618c318a-1jammy ceph-mgr=20.3.0-5507-g618c318a-1jammy ceph-osd=20.3.0-5507-g618c318a-1jammy ceph-osd-classic=20.3.0-5507-g618c318a-1jammy ceph-common=20.3.0-5507-g618c318a-1jammy ceph-fuse=20.3.0-5507-g618c318a-1jammy ceph-test=20.3.0-5507-g618c318a-1jammy ceph-volume=20.3.0-5507-g618c318a-1jammy radosgw=20.3.0-5507-g618c318a-1jammy python3-rados=20.3.0-5507-g618c318a-1jammy python3-rgw=20.3.0-5507-g618c318a-1jammy python3-cephfs=20.3.0-5507-g618c318a-1jammy python3-rbd=20.3.0-5507-g618c318a-1jammy libcephfs2=20.3.0-5507-g618c318a-1jammy libcephfs-dev=20.3.0-5507-g618c318a-1jammy librados2=20.3.0-5507-g618c318a-1jammy librbd1=20.3.0-5507-g618c318a-1jammy rbd-fuse=20.3.0-5507-g618c318a-1jammy 2026-02-24T17:22:18.276 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-24T17:22:18.290 DEBUG:teuthology.orchestra.run.trial109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5507-g618c318a-1jammy cephadm=20.3.0-5507-g618c318a-1jammy ceph-mds=20.3.0-5507-g618c318a-1jammy ceph-mgr=20.3.0-5507-g618c318a-1jammy ceph-osd=20.3.0-5507-g618c318a-1jammy ceph-osd-classic=20.3.0-5507-g618c318a-1jammy ceph-common=20.3.0-5507-g618c318a-1jammy ceph-fuse=20.3.0-5507-g618c318a-1jammy ceph-test=20.3.0-5507-g618c318a-1jammy ceph-volume=20.3.0-5507-g618c318a-1jammy radosgw=20.3.0-5507-g618c318a-1jammy python3-rados=20.3.0-5507-g618c318a-1jammy python3-rgw=20.3.0-5507-g618c318a-1jammy python3-cephfs=20.3.0-5507-g618c318a-1jammy python3-rbd=20.3.0-5507-g618c318a-1jammy libcephfs2=20.3.0-5507-g618c318a-1jammy libcephfs-dev=20.3.0-5507-g618c318a-1jammy librados2=20.3.0-5507-g618c318a-1jammy librbd1=20.3.0-5507-g618c318a-1jammy rbd-fuse=20.3.0-5507-g618c318a-1jammy 2026-02-24T17:22:18.301 INFO:teuthology.orchestra.run.trial094.stdout:Reading package lists... 2026-02-24T17:22:18.305 INFO:teuthology.orchestra.run.trial120.stdout:Reading package lists... 2026-02-24T17:22:18.325 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-24T17:22:18.356 INFO:teuthology.orchestra.run.trial040.stdout:Building dependency tree... 2026-02-24T17:22:18.357 INFO:teuthology.orchestra.run.trial040.stdout:Reading state information... 2026-02-24T17:22:18.409 INFO:teuthology.orchestra.run.trial094.stdout:Building dependency tree... 2026-02-24T17:22:18.410 INFO:teuthology.orchestra.run.trial094.stdout:Reading state information... 2026-02-24T17:22:18.415 INFO:teuthology.orchestra.run.trial120.stdout:Building dependency tree... 2026-02-24T17:22:18.415 INFO:teuthology.orchestra.run.trial120.stdout:Reading state information... 2026-02-24T17:22:18.432 INFO:teuthology.orchestra.run.trial109.stdout:Building dependency tree... 2026-02-24T17:22:18.433 INFO:teuthology.orchestra.run.trial109.stdout:Reading state information... 2026-02-24T17:22:18.447 INFO:teuthology.orchestra.run.trial040.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:22:18.447 INFO:teuthology.orchestra.run.trial040.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout:The following additional packages will be installed: 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-24T17:22:18.448 INFO:teuthology.orchestra.run.trial040.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout:Suggested packages: 2026-02-24T17:22:18.449 INFO:teuthology.orchestra.run.trial040.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-24T17:22:18.450 INFO:teuthology.orchestra.run.trial040.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-24T17:22:18.450 INFO:teuthology.orchestra.run.trial040.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-24T17:22:18.450 INFO:teuthology.orchestra.run.trial040.stdout:Recommended packages: 2026-02-24T17:22:18.450 INFO:teuthology.orchestra.run.trial040.stdout: btrfs-tools 2026-02-24T17:22:18.481 INFO:teuthology.orchestra.run.trial040.stdout:The following NEW packages will be installed: 2026-02-24T17:22:18.481 INFO:teuthology.orchestra.run.trial040.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-24T17:22:18.482 INFO:teuthology.orchestra.run.trial040.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-24T17:22:18.483 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-24T17:22:18.483 INFO:teuthology.orchestra.run.trial040.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-24T17:22:18.483 INFO:teuthology.orchestra.run.trial040.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-24T17:22:18.483 INFO:teuthology.orchestra.run.trial040.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-24T17:22:18.483 INFO:teuthology.orchestra.run.trial040.stdout: socat xmlstarlet 2026-02-24T17:22:18.499 INFO:teuthology.orchestra.run.trial094.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:22:18.499 INFO:teuthology.orchestra.run.trial094.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:22:18.499 INFO:teuthology.orchestra.run.trial094.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout:The following additional packages will be installed: 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-24T17:22:18.500 INFO:teuthology.orchestra.run.trial094.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-24T17:22:18.501 INFO:teuthology.orchestra.run.trial094.stdout:Suggested packages: 2026-02-24T17:22:18.502 INFO:teuthology.orchestra.run.trial094.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-24T17:22:18.502 INFO:teuthology.orchestra.run.trial094.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-24T17:22:18.502 INFO:teuthology.orchestra.run.trial094.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-24T17:22:18.502 INFO:teuthology.orchestra.run.trial094.stdout:Recommended packages: 2026-02-24T17:22:18.502 INFO:teuthology.orchestra.run.trial094.stdout: btrfs-tools 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout:The following additional packages will be installed: 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-24T17:22:18.505 INFO:teuthology.orchestra.run.trial120.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-24T17:22:18.506 INFO:teuthology.orchestra.run.trial120.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-24T17:22:18.507 INFO:teuthology.orchestra.run.trial120.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-24T17:22:18.507 INFO:teuthology.orchestra.run.trial120.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-24T17:22:18.507 INFO:teuthology.orchestra.run.trial120.stdout:Suggested packages: 2026-02-24T17:22:18.507 INFO:teuthology.orchestra.run.trial120.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-24T17:22:18.507 INFO:teuthology.orchestra.run.trial120.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-24T17:22:18.507 INFO:teuthology.orchestra.run.trial120.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-24T17:22:18.507 INFO:teuthology.orchestra.run.trial120.stdout:Recommended packages: 2026-02-24T17:22:18.507 INFO:teuthology.orchestra.run.trial120.stdout: btrfs-tools 2026-02-24T17:22:18.523 INFO:teuthology.orchestra.run.trial109.stdout:The following packages were automatically installed and are no longer required: 2026-02-24T17:22:18.523 INFO:teuthology.orchestra.run.trial109.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-24T17:22:18.523 INFO:teuthology.orchestra.run.trial109.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 2026-02-24T17:22:18.523 INFO:teuthology.orchestra.run.trial109.stdout: linux-headers-5.15.0-164 linux-headers-5.15.0-164-generic 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: linux-image-5.15.0-164-generic linux-modules-5.15.0-164-generic 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: linux-modules-extra-5.15.0-164-generic sg3-utils sg3-utils-udev 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout:The following additional packages will be installed: 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-24T17:22:18.524 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout:Suggested packages: 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-24T17:22:18.525 INFO:teuthology.orchestra.run.trial109.stdout:Recommended packages: 2026-02-24T17:22:18.526 INFO:teuthology.orchestra.run.trial109.stdout: btrfs-tools 2026-02-24T17:22:18.533 INFO:teuthology.orchestra.run.trial094.stdout:The following NEW packages will be installed: 2026-02-24T17:22:18.533 INFO:teuthology.orchestra.run.trial094.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-24T17:22:18.533 INFO:teuthology.orchestra.run.trial094.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-24T17:22:18.533 INFO:teuthology.orchestra.run.trial094.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-24T17:22:18.533 INFO:teuthology.orchestra.run.trial094.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-24T17:22:18.533 INFO:teuthology.orchestra.run.trial094.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-24T17:22:18.533 INFO:teuthology.orchestra.run.trial094.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-24T17:22:18.533 INFO:teuthology.orchestra.run.trial094.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-24T17:22:18.534 INFO:teuthology.orchestra.run.trial094.stdout: socat xmlstarlet 2026-02-24T17:22:18.538 INFO:teuthology.orchestra.run.trial120.stdout:The following NEW packages will be installed: 2026-02-24T17:22:18.538 INFO:teuthology.orchestra.run.trial120.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-24T17:22:18.538 INFO:teuthology.orchestra.run.trial120.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-24T17:22:18.538 INFO:teuthology.orchestra.run.trial120.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-24T17:22:18.538 INFO:teuthology.orchestra.run.trial120.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-24T17:22:18.538 INFO:teuthology.orchestra.run.trial120.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-24T17:22:18.538 INFO:teuthology.orchestra.run.trial120.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-24T17:22:18.538 INFO:teuthology.orchestra.run.trial120.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-24T17:22:18.539 INFO:teuthology.orchestra.run.trial120.stdout: socat xmlstarlet 2026-02-24T17:22:18.556 INFO:teuthology.orchestra.run.trial109.stdout:The following NEW packages will be installed: 2026-02-24T17:22:18.556 INFO:teuthology.orchestra.run.trial109.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-24T17:22:18.557 INFO:teuthology.orchestra.run.trial109.stdout: socat xmlstarlet 2026-02-24T17:22:18.644 INFO:teuthology.orchestra.run.trial120.stdout:0 upgraded, 87 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:22:18.644 INFO:teuthology.orchestra.run.trial120.stdout:Need to get 693 MB of archives. 2026-02-24T17:22:18.644 INFO:teuthology.orchestra.run.trial120.stdout:After this operation, 2583 MB of additional disk space will be used. 2026-02-24T17:22:18.644 INFO:teuthology.orchestra.run.trial120.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-24T17:22:18.690 INFO:teuthology.orchestra.run.trial120.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-24T17:22:18.690 INFO:teuthology.orchestra.run.trial120.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-24T17:22:18.700 INFO:teuthology.orchestra.run.trial120.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-24T17:22:18.729 INFO:teuthology.orchestra.run.trial120.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-24T17:22:18.730 INFO:teuthology.orchestra.run.trial120.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-24T17:22:18.735 INFO:teuthology.orchestra.run.trial120.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-24T17:22:18.737 INFO:teuthology.orchestra.run.trial120.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-24T17:22:18.738 INFO:teuthology.orchestra.run.trial120.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-24T17:22:18.738 INFO:teuthology.orchestra.run.trial120.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-24T17:22:18.738 INFO:teuthology.orchestra.run.trial120.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-24T17:22:18.743 INFO:teuthology.orchestra.run.trial120.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-24T17:22:18.743 INFO:teuthology.orchestra.run.trial120.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-24T17:22:18.743 INFO:teuthology.orchestra.run.trial120.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-24T17:22:18.749 INFO:teuthology.orchestra.run.trial120.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-24T17:22:18.750 INFO:teuthology.orchestra.run.trial120.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-24T17:22:18.750 INFO:teuthology.orchestra.run.trial120.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-24T17:22:18.750 INFO:teuthology.orchestra.run.trial120.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-24T17:22:18.750 INFO:teuthology.orchestra.run.trial120.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-24T17:22:18.760 INFO:teuthology.orchestra.run.trial120.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-24T17:22:18.760 INFO:teuthology.orchestra.run.trial120.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-24T17:22:18.762 INFO:teuthology.orchestra.run.trial120.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-24T17:22:18.762 INFO:teuthology.orchestra.run.trial120.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-24T17:22:18.763 INFO:teuthology.orchestra.run.trial120.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-24T17:22:18.770 INFO:teuthology.orchestra.run.trial120.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-24T17:22:18.770 INFO:teuthology.orchestra.run.trial120.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-24T17:22:18.770 INFO:teuthology.orchestra.run.trial120.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-24T17:22:18.784 INFO:teuthology.orchestra.run.trial120.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-24T17:22:18.786 INFO:teuthology.orchestra.run.trial120.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-24T17:22:18.786 INFO:teuthology.orchestra.run.trial120.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-24T17:22:18.796 INFO:teuthology.orchestra.run.trial120.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-24T17:22:18.796 INFO:teuthology.orchestra.run.trial120.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-24T17:22:18.797 INFO:teuthology.orchestra.run.trial120.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-24T17:22:18.797 INFO:teuthology.orchestra.run.trial120.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-24T17:22:18.797 INFO:teuthology.orchestra.run.trial120.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-24T17:22:18.797 INFO:teuthology.orchestra.run.trial120.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-24T17:22:18.798 INFO:teuthology.orchestra.run.trial120.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-24T17:22:18.799 INFO:teuthology.orchestra.run.trial120.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-24T17:22:18.800 INFO:teuthology.orchestra.run.trial120.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-24T17:22:18.807 INFO:teuthology.orchestra.run.trial120.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-24T17:22:18.809 INFO:teuthology.orchestra.run.trial120.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-24T17:22:18.810 INFO:teuthology.orchestra.run.trial120.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-24T17:22:18.812 INFO:teuthology.orchestra.run.trial120.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-24T17:22:18.814 INFO:teuthology.orchestra.run.trial120.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-24T17:22:18.814 INFO:teuthology.orchestra.run.trial120.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-24T17:22:18.817 INFO:teuthology.orchestra.run.trial120.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-24T17:22:18.818 INFO:teuthology.orchestra.run.trial120.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-24T17:22:18.818 INFO:teuthology.orchestra.run.trial120.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-24T17:22:18.821 INFO:teuthology.orchestra.run.trial120.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-24T17:22:18.827 INFO:teuthology.orchestra.run.trial120.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-24T17:22:18.828 INFO:teuthology.orchestra.run.trial120.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-24T17:22:18.829 INFO:teuthology.orchestra.run.trial120.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-24T17:22:18.829 INFO:teuthology.orchestra.run.trial120.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-24T17:22:18.842 INFO:teuthology.orchestra.run.trial040.stdout:0 upgraded, 87 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:22:18.842 INFO:teuthology.orchestra.run.trial040.stdout:Need to get 693 MB of archives. 2026-02-24T17:22:18.843 INFO:teuthology.orchestra.run.trial040.stdout:After this operation, 2583 MB of additional disk space will be used. 2026-02-24T17:22:18.843 INFO:teuthology.orchestra.run.trial040.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5507-g618c318a-1jammy [3796 kB] 2026-02-24T17:22:18.898 INFO:teuthology.orchestra.run.trial094.stdout:0 upgraded, 87 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:22:18.898 INFO:teuthology.orchestra.run.trial094.stdout:Need to get 693 MB of archives. 2026-02-24T17:22:18.898 INFO:teuthology.orchestra.run.trial094.stdout:After this operation, 2583 MB of additional disk space will be used. 2026-02-24T17:22:18.898 INFO:teuthology.orchestra.run.trial094.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5507-g618c318a-1jammy [3796 kB] 2026-02-24T17:22:18.899 INFO:teuthology.orchestra.run.trial040.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-24T17:22:18.904 INFO:teuthology.orchestra.run.trial120.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5507-g618c318a-1jammy [3796 kB] 2026-02-24T17:22:18.923 INFO:teuthology.orchestra.run.trial109.stdout:0 upgraded, 87 newly installed, 0 to remove and 14 not upgraded. 2026-02-24T17:22:18.923 INFO:teuthology.orchestra.run.trial109.stdout:Need to get 693 MB of archives. 2026-02-24T17:22:18.923 INFO:teuthology.orchestra.run.trial109.stdout:After this operation, 2583 MB of additional disk space will be used. 2026-02-24T17:22:18.923 INFO:teuthology.orchestra.run.trial109.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5507-g618c318a-1jammy [3796 kB] 2026-02-24T17:22:18.953 INFO:teuthology.orchestra.run.trial094.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-24T17:22:18.976 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-24T17:22:19.311 INFO:teuthology.orchestra.run.trial040.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-24T17:22:19.324 INFO:teuthology.orchestra.run.trial040.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-24T17:22:19.366 INFO:teuthology.orchestra.run.trial094.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-24T17:22:19.379 INFO:teuthology.orchestra.run.trial094.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-24T17:22:19.389 INFO:teuthology.orchestra.run.trial109.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-24T17:22:19.402 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-24T17:22:19.409 INFO:teuthology.orchestra.run.trial040.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-24T17:22:19.464 INFO:teuthology.orchestra.run.trial094.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-24T17:22:19.488 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-24T17:22:19.530 INFO:teuthology.orchestra.run.trial120.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5507-g618c318a-1jammy [2910 kB] 2026-02-24T17:22:19.654 INFO:teuthology.orchestra.run.trial040.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-24T17:22:19.667 INFO:teuthology.orchestra.run.trial040.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-24T17:22:19.699 INFO:teuthology.orchestra.run.trial040.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-24T17:22:19.709 INFO:teuthology.orchestra.run.trial040.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-24T17:22:19.709 INFO:teuthology.orchestra.run.trial094.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-24T17:22:19.711 INFO:teuthology.orchestra.run.trial040.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-24T17:22:19.712 INFO:teuthology.orchestra.run.trial040.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-24T17:22:19.713 INFO:teuthology.orchestra.run.trial040.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-24T17:22:19.722 INFO:teuthology.orchestra.run.trial094.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-24T17:22:19.732 INFO:teuthology.orchestra.run.trial120.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5507-g618c318a-1jammy [883 kB] 2026-02-24T17:22:19.733 INFO:teuthology.orchestra.run.trial109.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-24T17:22:19.734 INFO:teuthology.orchestra.run.trial040.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-24T17:22:19.735 INFO:teuthology.orchestra.run.trial040.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-24T17:22:19.742 INFO:teuthology.orchestra.run.trial040.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-24T17:22:19.746 INFO:teuthology.orchestra.run.trial109.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-24T17:22:19.754 INFO:teuthology.orchestra.run.trial094.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-24T17:22:19.764 INFO:teuthology.orchestra.run.trial094.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-24T17:22:19.767 INFO:teuthology.orchestra.run.trial094.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-24T17:22:19.768 INFO:teuthology.orchestra.run.trial094.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-24T17:22:19.769 INFO:teuthology.orchestra.run.trial094.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-24T17:22:19.778 INFO:teuthology.orchestra.run.trial109.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-24T17:22:19.789 INFO:teuthology.orchestra.run.trial109.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-24T17:22:19.789 INFO:teuthology.orchestra.run.trial094.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-24T17:22:19.790 INFO:teuthology.orchestra.run.trial094.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-24T17:22:19.791 INFO:teuthology.orchestra.run.trial109.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-24T17:22:19.792 INFO:teuthology.orchestra.run.trial109.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-24T17:22:19.793 INFO:teuthology.orchestra.run.trial109.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-24T17:22:19.797 INFO:teuthology.orchestra.run.trial094.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-24T17:22:19.798 INFO:teuthology.orchestra.run.trial120.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5507-g618c318a-1jammy [359 kB] 2026-02-24T17:22:19.805 INFO:teuthology.orchestra.run.trial120.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5507-g618c318a-1jammy [32.8 kB] 2026-02-24T17:22:19.805 INFO:teuthology.orchestra.run.trial120.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5507-g618c318a-1jammy [225 kB] 2026-02-24T17:22:19.809 INFO:teuthology.orchestra.run.trial120.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5507-g618c318a-1jammy [88.9 kB] 2026-02-24T17:22:19.811 INFO:teuthology.orchestra.run.trial120.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5507-g618c318a-1jammy [338 kB] 2026-02-24T17:22:19.813 INFO:teuthology.orchestra.run.trial109.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-24T17:22:19.814 INFO:teuthology.orchestra.run.trial109.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-24T17:22:19.822 INFO:teuthology.orchestra.run.trial109.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-24T17:22:19.822 INFO:teuthology.orchestra.run.trial040.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-24T17:22:19.823 INFO:teuthology.orchestra.run.trial040.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-24T17:22:19.823 INFO:teuthology.orchestra.run.trial040.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-24T17:22:19.823 INFO:teuthology.orchestra.run.trial040.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-24T17:22:19.824 INFO:teuthology.orchestra.run.trial040.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-24T17:22:19.824 INFO:teuthology.orchestra.run.trial040.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-24T17:22:19.824 INFO:teuthology.orchestra.run.trial040.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-24T17:22:19.829 INFO:teuthology.orchestra.run.trial040.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-24T17:22:19.829 INFO:teuthology.orchestra.run.trial040.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-24T17:22:19.868 INFO:teuthology.orchestra.run.trial120.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5507-g618c318a-1jammy [9130 kB] 2026-02-24T17:22:19.879 INFO:teuthology.orchestra.run.trial094.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-24T17:22:19.879 INFO:teuthology.orchestra.run.trial094.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-24T17:22:19.879 INFO:teuthology.orchestra.run.trial094.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-24T17:22:19.879 INFO:teuthology.orchestra.run.trial094.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-24T17:22:19.880 INFO:teuthology.orchestra.run.trial094.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-24T17:22:19.880 INFO:teuthology.orchestra.run.trial094.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-24T17:22:19.880 INFO:teuthology.orchestra.run.trial094.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-24T17:22:19.885 INFO:teuthology.orchestra.run.trial094.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-24T17:22:19.886 INFO:teuthology.orchestra.run.trial094.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-24T17:22:19.902 INFO:teuthology.orchestra.run.trial109.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-24T17:22:19.903 INFO:teuthology.orchestra.run.trial109.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-24T17:22:19.903 INFO:teuthology.orchestra.run.trial109.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-24T17:22:19.903 INFO:teuthology.orchestra.run.trial109.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-24T17:22:19.903 INFO:teuthology.orchestra.run.trial109.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-24T17:22:19.904 INFO:teuthology.orchestra.run.trial109.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-24T17:22:19.904 INFO:teuthology.orchestra.run.trial109.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-24T17:22:19.909 INFO:teuthology.orchestra.run.trial109.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-24T17:22:19.910 INFO:teuthology.orchestra.run.trial109.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-24T17:22:19.914 INFO:teuthology.orchestra.run.trial040.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-24T17:22:19.916 INFO:teuthology.orchestra.run.trial040.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-24T17:22:19.917 INFO:teuthology.orchestra.run.trial040.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-24T17:22:19.918 INFO:teuthology.orchestra.run.trial040.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-24T17:22:19.948 INFO:teuthology.orchestra.run.trial040.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-24T17:22:19.950 INFO:teuthology.orchestra.run.trial040.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-24T17:22:19.951 INFO:teuthology.orchestra.run.trial040.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-24T17:22:19.972 INFO:teuthology.orchestra.run.trial094.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-24T17:22:19.974 INFO:teuthology.orchestra.run.trial094.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-24T17:22:19.975 INFO:teuthology.orchestra.run.trial094.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-24T17:22:19.976 INFO:teuthology.orchestra.run.trial094.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-24T17:22:19.994 INFO:teuthology.orchestra.run.trial109.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-24T17:22:19.997 INFO:teuthology.orchestra.run.trial109.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-24T17:22:19.997 INFO:teuthology.orchestra.run.trial109.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-24T17:22:19.999 INFO:teuthology.orchestra.run.trial109.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-24T17:22:20.006 INFO:teuthology.orchestra.run.trial094.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-24T17:22:20.009 INFO:teuthology.orchestra.run.trial094.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-24T17:22:20.009 INFO:teuthology.orchestra.run.trial094.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-24T17:22:20.021 INFO:teuthology.orchestra.run.trial040.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-24T17:22:20.022 INFO:teuthology.orchestra.run.trial040.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-24T17:22:20.022 INFO:teuthology.orchestra.run.trial040.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-24T17:22:20.022 INFO:teuthology.orchestra.run.trial040.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-24T17:22:20.023 INFO:teuthology.orchestra.run.trial040.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-24T17:22:20.023 INFO:teuthology.orchestra.run.trial040.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-24T17:22:20.028 INFO:teuthology.orchestra.run.trial109.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-24T17:22:20.032 INFO:teuthology.orchestra.run.trial109.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-24T17:22:20.032 INFO:teuthology.orchestra.run.trial109.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-24T17:22:20.080 INFO:teuthology.orchestra.run.trial094.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-24T17:22:20.080 INFO:teuthology.orchestra.run.trial094.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-24T17:22:20.080 INFO:teuthology.orchestra.run.trial094.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-24T17:22:20.081 INFO:teuthology.orchestra.run.trial094.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-24T17:22:20.094 INFO:teuthology.orchestra.run.trial040.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-24T17:22:20.096 INFO:teuthology.orchestra.run.trial040.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-24T17:22:20.097 INFO:teuthology.orchestra.run.trial040.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-24T17:22:20.102 INFO:teuthology.orchestra.run.trial109.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-24T17:22:20.103 INFO:teuthology.orchestra.run.trial109.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-24T17:22:20.103 INFO:teuthology.orchestra.run.trial109.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-24T17:22:20.104 INFO:teuthology.orchestra.run.trial109.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-24T17:22:20.104 INFO:teuthology.orchestra.run.trial109.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-24T17:22:20.104 INFO:teuthology.orchestra.run.trial109.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-24T17:22:20.151 INFO:teuthology.orchestra.run.trial094.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-24T17:22:20.152 INFO:teuthology.orchestra.run.trial094.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-24T17:22:20.155 INFO:teuthology.orchestra.run.trial094.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-24T17:22:20.157 INFO:teuthology.orchestra.run.trial094.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-24T17:22:20.158 INFO:teuthology.orchestra.run.trial094.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-24T17:22:20.175 INFO:teuthology.orchestra.run.trial109.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-24T17:22:20.177 INFO:teuthology.orchestra.run.trial109.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-24T17:22:20.179 INFO:teuthology.orchestra.run.trial109.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-24T17:22:20.183 INFO:teuthology.orchestra.run.trial040.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-24T17:22:20.186 INFO:teuthology.orchestra.run.trial040.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-24T17:22:20.189 INFO:teuthology.orchestra.run.trial040.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-24T17:22:20.193 INFO:teuthology.orchestra.run.trial040.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-24T17:22:20.196 INFO:teuthology.orchestra.run.trial040.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-24T17:22:20.197 INFO:teuthology.orchestra.run.trial040.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-24T17:22:20.197 INFO:teuthology.orchestra.run.trial040.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-24T17:22:20.240 INFO:teuthology.orchestra.run.trial094.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-24T17:22:20.243 INFO:teuthology.orchestra.run.trial094.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-24T17:22:20.245 INFO:teuthology.orchestra.run.trial094.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-24T17:22:20.250 INFO:teuthology.orchestra.run.trial094.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-24T17:22:20.253 INFO:teuthology.orchestra.run.trial094.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-24T17:22:20.264 INFO:teuthology.orchestra.run.trial109.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-24T17:22:20.267 INFO:teuthology.orchestra.run.trial109.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-24T17:22:20.270 INFO:teuthology.orchestra.run.trial109.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-24T17:22:20.271 INFO:teuthology.orchestra.run.trial040.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-24T17:22:20.271 INFO:teuthology.orchestra.run.trial040.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-24T17:22:20.274 INFO:teuthology.orchestra.run.trial109.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-24T17:22:20.277 INFO:teuthology.orchestra.run.trial109.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-24T17:22:20.277 INFO:teuthology.orchestra.run.trial109.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-24T17:22:20.278 INFO:teuthology.orchestra.run.trial109.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-24T17:22:20.278 INFO:teuthology.orchestra.run.trial040.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-24T17:22:20.328 INFO:teuthology.orchestra.run.trial094.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-24T17:22:20.328 INFO:teuthology.orchestra.run.trial094.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-24T17:22:20.329 INFO:teuthology.orchestra.run.trial094.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-24T17:22:20.330 INFO:teuthology.orchestra.run.trial094.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-24T17:22:20.337 INFO:teuthology.orchestra.run.trial094.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-24T17:22:20.352 INFO:teuthology.orchestra.run.trial109.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-24T17:22:20.353 INFO:teuthology.orchestra.run.trial109.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-24T17:22:20.358 INFO:teuthology.orchestra.run.trial040.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-24T17:22:20.360 INFO:teuthology.orchestra.run.trial109.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-24T17:22:20.361 INFO:teuthology.orchestra.run.trial040.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-24T17:22:20.361 INFO:teuthology.orchestra.run.trial040.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-24T17:22:20.362 INFO:teuthology.orchestra.run.trial040.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-24T17:22:20.416 INFO:teuthology.orchestra.run.trial094.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-24T17:22:20.418 INFO:teuthology.orchestra.run.trial094.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-24T17:22:20.418 INFO:teuthology.orchestra.run.trial094.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-24T17:22:20.419 INFO:teuthology.orchestra.run.trial094.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-24T17:22:20.441 INFO:teuthology.orchestra.run.trial109.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-24T17:22:20.443 INFO:teuthology.orchestra.run.trial109.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-24T17:22:20.443 INFO:teuthology.orchestra.run.trial109.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-24T17:22:20.444 INFO:teuthology.orchestra.run.trial109.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-24T17:22:20.488 INFO:teuthology.orchestra.run.trial120.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5507-g618c318a-1jammy [112 kB] 2026-02-24T17:22:20.489 INFO:teuthology.orchestra.run.trial120.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5507-g618c318a-1jammy [261 kB] 2026-02-24T17:22:20.494 INFO:teuthology.orchestra.run.trial120.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5507-g618c318a-1jammy [31.6 MB] 2026-02-24T17:22:20.581 INFO:teuthology.orchestra.run.trial040.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5507-g618c318a-1jammy [2910 kB] 2026-02-24T17:22:21.607 INFO:teuthology.orchestra.run.trial040.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5507-g618c318a-1jammy [883 kB] 2026-02-24T17:22:21.870 INFO:teuthology.orchestra.run.trial040.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5507-g618c318a-1jammy [359 kB] 2026-02-24T17:22:21.999 INFO:teuthology.orchestra.run.trial040.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5507-g618c318a-1jammy [32.8 kB] 2026-02-24T17:22:21.999 INFO:teuthology.orchestra.run.trial040.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5507-g618c318a-1jammy [225 kB] 2026-02-24T17:22:22.126 INFO:teuthology.orchestra.run.trial040.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5507-g618c318a-1jammy [88.9 kB] 2026-02-24T17:22:22.128 INFO:teuthology.orchestra.run.trial040.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5507-g618c318a-1jammy [338 kB] 2026-02-24T17:22:22.246 INFO:teuthology.orchestra.run.trial094.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5507-g618c318a-1jammy [2910 kB] 2026-02-24T17:22:22.259 INFO:teuthology.orchestra.run.trial040.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5507-g618c318a-1jammy [9130 kB] 2026-02-24T17:22:22.427 INFO:teuthology.orchestra.run.trial120.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5507-g618c318a-1jammy [4984 kB] 2026-02-24T17:22:22.699 INFO:teuthology.orchestra.run.trial120.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5507-g618c318a-1jammy [295 kB] 2026-02-24T17:22:22.704 INFO:teuthology.orchestra.run.trial120.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5507-g618c318a-1jammy [127 kB] 2026-02-24T17:22:22.707 INFO:teuthology.orchestra.run.trial120.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5507-g618c318a-1jammy [934 kB] 2026-02-24T17:22:22.770 INFO:teuthology.orchestra.run.trial120.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5507-g618c318a-1jammy [7550 kB] 2026-02-24T17:22:23.198 INFO:teuthology.orchestra.run.trial120.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5507-g618c318a-1jammy [468 MB] 2026-02-24T17:22:24.145 INFO:teuthology.orchestra.run.trial109.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5507-g618c318a-1jammy [2910 kB] 2026-02-24T17:22:24.304 INFO:teuthology.orchestra.run.trial094.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5507-g618c318a-1jammy [883 kB] 2026-02-24T17:22:24.988 INFO:teuthology.orchestra.run.trial094.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5507-g618c318a-1jammy [359 kB] 2026-02-24T17:22:25.264 INFO:teuthology.orchestra.run.trial094.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5507-g618c318a-1jammy [32.8 kB] 2026-02-24T17:22:25.265 INFO:teuthology.orchestra.run.trial094.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5507-g618c318a-1jammy [225 kB] 2026-02-24T17:22:25.344 INFO:teuthology.orchestra.run.trial040.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5507-g618c318a-1jammy [112 kB] 2026-02-24T17:22:25.346 INFO:teuthology.orchestra.run.trial040.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5507-g618c318a-1jammy [261 kB] 2026-02-24T17:22:25.472 INFO:teuthology.orchestra.run.trial094.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5507-g618c318a-1jammy [88.9 kB] 2026-02-24T17:22:25.481 INFO:teuthology.orchestra.run.trial040.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5507-g618c318a-1jammy [31.6 MB] 2026-02-24T17:22:25.541 INFO:teuthology.orchestra.run.trial094.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5507-g618c318a-1jammy [338 kB] 2026-02-24T17:22:25.755 INFO:teuthology.orchestra.run.trial094.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5507-g618c318a-1jammy [9130 kB] 2026-02-24T17:22:26.892 INFO:teuthology.orchestra.run.trial109.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5507-g618c318a-1jammy [883 kB] 2026-02-24T17:22:27.621 INFO:teuthology.orchestra.run.trial109.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5507-g618c318a-1jammy [359 kB] 2026-02-24T17:22:27.897 INFO:teuthology.orchestra.run.trial109.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5507-g618c318a-1jammy [32.8 kB] 2026-02-24T17:22:27.922 INFO:teuthology.orchestra.run.trial109.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5507-g618c318a-1jammy [225 kB] 2026-02-24T17:22:28.064 INFO:teuthology.orchestra.run.trial109.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5507-g618c318a-1jammy [88.9 kB] 2026-02-24T17:22:28.134 INFO:teuthology.orchestra.run.trial109.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5507-g618c318a-1jammy [338 kB] 2026-02-24T17:22:28.412 INFO:teuthology.orchestra.run.trial109.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5507-g618c318a-1jammy [9130 kB] 2026-02-24T17:22:31.027 INFO:teuthology.orchestra.run.trial094.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5507-g618c318a-1jammy [112 kB] 2026-02-24T17:22:31.047 INFO:teuthology.orchestra.run.trial094.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5507-g618c318a-1jammy [261 kB] 2026-02-24T17:22:31.186 INFO:teuthology.orchestra.run.trial094.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5507-g618c318a-1jammy [31.6 MB] 2026-02-24T17:22:33.000 INFO:teuthology.orchestra.run.trial040.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5507-g618c318a-1jammy [4984 kB] 2026-02-24T17:22:33.884 INFO:teuthology.orchestra.run.trial040.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5507-g618c318a-1jammy [295 kB] 2026-02-24T17:22:33.928 INFO:teuthology.orchestra.run.trial040.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5507-g618c318a-1jammy [127 kB] 2026-02-24T17:22:33.948 INFO:teuthology.orchestra.run.trial040.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5507-g618c318a-1jammy [934 kB] 2026-02-24T17:22:34.086 INFO:teuthology.orchestra.run.trial040.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5507-g618c318a-1jammy [7550 kB] 2026-02-24T17:22:34.490 INFO:teuthology.orchestra.run.trial109.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5507-g618c318a-1jammy [112 kB] 2026-02-24T17:22:34.530 INFO:teuthology.orchestra.run.trial109.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5507-g618c318a-1jammy [261 kB] 2026-02-24T17:22:34.663 INFO:teuthology.orchestra.run.trial109.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5507-g618c318a-1jammy [31.6 MB] 2026-02-24T17:22:35.264 INFO:teuthology.orchestra.run.trial040.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5507-g618c318a-1jammy [468 MB] 2026-02-24T17:22:38.192 INFO:teuthology.orchestra.run.trial094.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5507-g618c318a-1jammy [4984 kB] 2026-02-24T17:22:38.929 INFO:teuthology.orchestra.run.trial094.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5507-g618c318a-1jammy [295 kB] 2026-02-24T17:22:38.993 INFO:teuthology.orchestra.run.trial094.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5507-g618c318a-1jammy [127 kB] 2026-02-24T17:22:38.997 INFO:teuthology.orchestra.run.trial094.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5507-g618c318a-1jammy [934 kB] 2026-02-24T17:22:39.150 INFO:teuthology.orchestra.run.trial094.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5507-g618c318a-1jammy [7550 kB] 2026-02-24T17:22:40.400 INFO:teuthology.orchestra.run.trial094.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5507-g618c318a-1jammy [468 MB] 2026-02-24T17:22:44.144 INFO:teuthology.orchestra.run.trial109.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5507-g618c318a-1jammy [4984 kB] 2026-02-24T17:22:45.342 INFO:teuthology.orchestra.run.trial109.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5507-g618c318a-1jammy [295 kB] 2026-02-24T17:22:45.412 INFO:teuthology.orchestra.run.trial109.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5507-g618c318a-1jammy [127 kB] 2026-02-24T17:22:45.426 INFO:teuthology.orchestra.run.trial109.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5507-g618c318a-1jammy [934 kB] 2026-02-24T17:22:45.638 INFO:teuthology.orchestra.run.trial109.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5507-g618c318a-1jammy [7550 kB] 2026-02-24T17:22:47.352 INFO:teuthology.orchestra.run.trial109.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5507-g618c318a-1jammy [468 MB] 2026-02-24T17:22:50.976 INFO:teuthology.orchestra.run.trial120.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5507-g618c318a-1jammy [180 kB] 2026-02-24T17:22:50.977 INFO:teuthology.orchestra.run.trial120.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5507-g618c318a-1jammy [14.1 kB] 2026-02-24T17:22:50.977 INFO:teuthology.orchestra.run.trial120.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5507-g618c318a-1jammy [1030 kB] 2026-02-24T17:22:50.982 INFO:teuthology.orchestra.run.trial120.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5507-g618c318a-1jammy [2437 kB] 2026-02-24T17:22:51.019 INFO:teuthology.orchestra.run.trial120.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5507-g618c318a-1jammy [1072 kB] 2026-02-24T17:22:51.159 INFO:teuthology.orchestra.run.trial120.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5507-g618c318a-1jammy [190 kB] 2026-02-24T17:22:51.160 INFO:teuthology.orchestra.run.trial120.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5507-g618c318a-1jammy [49.0 MB] 2026-02-24T17:22:55.046 INFO:teuthology.orchestra.run.trial120.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5507-g618c318a-1jammy [8626 kB] 2026-02-24T17:22:55.759 INFO:teuthology.orchestra.run.trial120.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5507-g618c318a-1jammy [14.2 kB] 2026-02-24T17:22:55.764 INFO:teuthology.orchestra.run.trial120.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5507-g618c318a-1jammy [65.5 MB] 2026-02-24T17:23:01.641 INFO:teuthology.orchestra.run.trial120.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5507-g618c318a-1jammy [136 kB] 2026-02-24T17:23:01.641 INFO:teuthology.orchestra.run.trial120.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5507-g618c318a-1jammy [47.3 kB] 2026-02-24T17:23:01.642 INFO:teuthology.orchestra.run.trial120.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5507-g618c318a-1jammy [33.1 kB] 2026-02-24T17:23:01.642 INFO:teuthology.orchestra.run.trial120.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5507-g618c318a-1jammy [44.2 kB] 2026-02-24T17:23:01.642 INFO:teuthology.orchestra.run.trial120.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5507-g618c318a-1jammy [18.4 MB] 2026-02-24T17:23:03.241 INFO:teuthology.orchestra.run.trial120.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5507-g618c318a-1jammy [93.7 kB] 2026-02-24T17:23:03.526 INFO:teuthology.orchestra.run.trial120.stdout:Fetched 693 MB in 45s (15.5 MB/s) 2026-02-24T17:23:03.546 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-24T17:23:03.714 INFO:teuthology.orchestra.run.trial120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 202926 files and directories currently installed.) 2026-02-24T17:23:03.717 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-24T17:23:03.718 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-24T17:23:03.739 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-24T17:23:03.753 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-24T17:23:03.754 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-24T17:23:03.771 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-24T17:23:03.784 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-24T17:23:03.784 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-24T17:23:03.801 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-24T17:23:03.812 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:03.817 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:03.847 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-24T17:23:03.857 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:03.857 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:03.873 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-24T17:23:03.883 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:03.883 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:03.902 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-24T17:23:03.912 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-24T17:23:03.913 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-24T17:23:03.929 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package librados2. 2026-02-24T17:23:03.939 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../07-librados2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:03.939 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking librados2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:03.984 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libnbd0. 2026-02-24T17:23:03.993 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-24T17:23:03.994 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-24T17:23:04.009 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package librbd1. 2026-02-24T17:23:04.018 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../09-librbd1_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.019 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking librbd1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.056 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libcephfs2. 2026-02-24T17:23:04.065 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.066 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libcephfs2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.086 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-rados. 2026-02-24T17:23:04.096 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.096 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-rados (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.115 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-24T17:23:04.124 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:04.125 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-ceph-argparse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.139 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-cephfs. 2026-02-24T17:23:04.149 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.149 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-cephfs (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.165 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-24T17:23:04.175 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:04.175 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.194 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-24T17:23:04.204 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-24T17:23:04.205 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-24T17:23:04.221 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-prettytable. 2026-02-24T17:23:04.231 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-24T17:23:04.231 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-24T17:23:04.246 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-rbd. 2026-02-24T17:23:04.255 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.256 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-rbd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.273 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-24T17:23:04.283 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-24T17:23:04.283 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-24T17:23:04.302 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package librgw2. 2026-02-24T17:23:04.311 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../19-librgw2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.311 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking librgw2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.411 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-rgw. 2026-02-24T17:23:04.421 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.421 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-rgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.437 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-24T17:23:04.446 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-24T17:23:04.447 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-24T17:23:04.461 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libradosstriper1. 2026-02-24T17:23:04.471 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.471 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libradosstriper1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.487 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-common. 2026-02-24T17:23:04.496 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.497 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.766 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-base. 2026-02-24T17:23:04.776 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:04.781 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-base (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:04.840 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-24T17:23:04.850 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-24T17:23:04.850 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-24T17:23:04.865 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-cheroot. 2026-02-24T17:23:04.876 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-24T17:23:04.876 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-24T17:23:04.894 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-24T17:23:04.904 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-24T17:23:04.905 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-24T17:23:04.919 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-24T17:23:04.929 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-24T17:23:04.930 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-24T17:23:04.944 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-24T17:23:04.954 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-24T17:23:04.954 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-24T17:23:04.969 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-tempora. 2026-02-24T17:23:04.979 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-24T17:23:04.979 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-24T17:23:04.994 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-portend. 2026-02-24T17:23:05.004 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-24T17:23:05.004 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-24T17:23:05.019 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-24T17:23:05.029 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-24T17:23:05.029 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-24T17:23:05.044 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-24T17:23:05.053 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-24T17:23:05.054 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-24T17:23:05.077 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-natsort. 2026-02-24T17:23:05.087 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-24T17:23:05.087 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-24T17:23:05.104 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-24T17:23:05.114 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:05.114 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:05.145 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-24T17:23:05.155 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:05.155 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:05.171 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-mgr. 2026-02-24T17:23:05.181 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:05.181 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-mgr (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:05.202 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-mon. 2026-02-24T17:23:05.212 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:05.212 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-mon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:05.278 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-24T17:23:05.288 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-24T17:23:05.289 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-24T17:23:05.305 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-24T17:23:05.315 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:05.315 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-osd-classic (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:09.309 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-osd. 2026-02-24T17:23:09.324 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:09.325 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-osd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:09.345 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph. 2026-02-24T17:23:09.360 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../42-ceph_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:09.361 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:09.375 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-fuse. 2026-02-24T17:23:09.390 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:09.391 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:09.415 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-mds. 2026-02-24T17:23:09.429 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:09.429 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-mds (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:09.462 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package cephadm. 2026-02-24T17:23:09.472 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../45-cephadm_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:09.472 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:09.489 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-24T17:23:09.499 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-24T17:23:09.499 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:09.521 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-24T17:23:09.531 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:09.531 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:09.553 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-24T17:23:09.562 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-24T17:23:09.562 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-24T17:23:09.578 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-routes. 2026-02-24T17:23:09.588 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-24T17:23:09.588 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-24T17:23:09.608 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-24T17:23:09.618 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:09.619 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:10.167 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-24T17:23:10.178 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-24T17:23:10.178 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-24T17:23:10.216 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-joblib. 2026-02-24T17:23:10.226 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-24T17:23:10.227 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-24T17:23:10.254 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-24T17:23:10.264 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-24T17:23:10.265 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-24T17:23:10.279 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-sklearn. 2026-02-24T17:23:10.289 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-24T17:23:10.290 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-24T17:23:10.369 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-24T17:23:10.380 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:10.381 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:10.541 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-cachetools. 2026-02-24T17:23:10.552 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-24T17:23:10.553 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-24T17:23:10.567 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-rsa. 2026-02-24T17:23:10.577 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-24T17:23:10.578 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-24T17:23:10.595 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-google-auth. 2026-02-24T17:23:10.606 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-24T17:23:10.606 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-24T17:23:10.623 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-24T17:23:10.633 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-24T17:23:10.634 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-24T17:23:10.650 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-websocket. 2026-02-24T17:23:10.661 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-24T17:23:10.661 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-24T17:23:10.679 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-24T17:23:10.689 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-24T17:23:10.690 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-24T17:23:10.786 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-24T17:23:10.797 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:10.797 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:10.811 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-24T17:23:10.821 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-24T17:23:10.821 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-24T17:23:10.837 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-24T17:23:10.847 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-24T17:23:10.848 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:10.862 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package jq. 2026-02-24T17:23:10.872 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-24T17:23:10.873 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:10.888 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package socat. 2026-02-24T17:23:10.899 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-24T17:23:10.899 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-24T17:23:10.921 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package xmlstarlet. 2026-02-24T17:23:10.931 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-24T17:23:10.931 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-24T17:23:10.967 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-test. 2026-02-24T17:23:10.977 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:10.977 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-test (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:11.627 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package ceph-volume. 2026-02-24T17:23:11.638 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:11.638 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking ceph-volume (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:11.661 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-24T17:23:11.671 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:11.671 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libcephfs-daemon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:11.686 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-24T17:23:11.697 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:11.697 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libcephfs-proxy2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:11.713 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-24T17:23:11.723 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:11.723 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking libcephfs-dev (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:11.740 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package nvme-cli. 2026-02-24T17:23:11.750 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-24T17:23:11.750 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-24T17:23:11.781 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-24T17:23:11.791 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-24T17:23:11.792 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:11.821 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-24T17:23:11.833 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-24T17:23:11.833 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-24T17:23:11.848 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-pluggy. 2026-02-24T17:23:11.857 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-24T17:23:11.858 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-24T17:23:11.873 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-psutil. 2026-02-24T17:23:11.884 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-24T17:23:11.884 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-24T17:23:11.903 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-py. 2026-02-24T17:23:11.912 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-24T17:23:11.913 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-24T17:23:11.933 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-pygments. 2026-02-24T17:23:11.943 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-24T17:23:11.944 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-24T17:23:11.987 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-toml. 2026-02-24T17:23:11.998 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-24T17:23:11.998 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-24T17:23:12.013 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-pytest. 2026-02-24T17:23:12.023 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-24T17:23:12.023 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-24T17:23:12.045 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-simplejson. 2026-02-24T17:23:12.055 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-24T17:23:12.056 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-24T17:23:12.081 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package python3-webob. 2026-02-24T17:23:12.091 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-24T17:23:12.092 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-24T17:23:12.108 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-24T17:23:12.119 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-24T17:23:12.119 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-24T17:23:12.185 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package radosgw. 2026-02-24T17:23:12.196 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../85-radosgw_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:12.196 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking radosgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:12.356 INFO:teuthology.orchestra.run.trial120.stdout:Selecting previously unselected package rbd-fuse. 2026-02-24T17:23:12.366 INFO:teuthology.orchestra.run.trial120.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:12.367 INFO:teuthology.orchestra.run.trial120.stdout:Unpacking rbd-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:12.395 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-24T17:23:12.462 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-24T17:23:12.463 INFO:teuthology.orchestra.run.trial120.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-24T17:23:12.535 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T17:23:12.827 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-24T17:23:13.209 INFO:teuthology.orchestra.run.trial120.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-24T17:23:13.219 INFO:teuthology.orchestra.run.trial120.stdout:Setting up cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:13.264 INFO:teuthology.orchestra.run.trial120.stdout:Adding system user cephadm....done 2026-02-24T17:23:13.270 INFO:teuthology.orchestra.run.trial120.stdout:usermod: no changes 2026-02-24T17:23:13.277 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-24T17:23:13.347 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:13.348 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-24T17:23:13.421 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-24T17:23:13.496 INFO:teuthology.orchestra.run.trial120.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-24T17:23:13.497 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-24T17:23:13.594 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-24T17:23:13.718 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-24T17:23:13.792 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-24T17:23:13.867 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-ceph-argparse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:13.935 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-24T17:23:13.935 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-24T17:23:13.936 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-24T17:23:13.937 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-24T17:23:13.938 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-24T17:23:14.063 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-24T17:23:14.143 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libcephfs-proxy2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:14.144 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-24T17:23:14.223 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-24T17:23:14.311 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-24T17:23:14.566 INFO:teuthology.orchestra.run.trial120.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-24T17:23:14.567 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-24T17:23:14.663 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:14.791 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-24T17:23:14.874 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-24T17:23:14.946 INFO:teuthology.orchestra.run.trial120.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-24T17:23:14.946 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:15.019 INFO:teuthology.orchestra.run.trial040.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5507-g618c318a-1jammy [180 kB] 2026-02-24T17:23:15.020 INFO:teuthology.orchestra.run.trial040.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5507-g618c318a-1jammy [14.1 kB] 2026-02-24T17:23:15.021 INFO:teuthology.orchestra.run.trial040.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5507-g618c318a-1jammy [1030 kB] 2026-02-24T17:23:15.037 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-24T17:23:15.039 INFO:teuthology.orchestra.run.trial040.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5507-g618c318a-1jammy [2437 kB] 2026-02-24T17:23:15.145 INFO:teuthology.orchestra.run.trial040.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5507-g618c318a-1jammy [1072 kB] 2026-02-24T17:23:15.202 INFO:teuthology.orchestra.run.trial040.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5507-g618c318a-1jammy [190 kB] 2026-02-24T17:23:15.205 INFO:teuthology.orchestra.run.trial040.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5507-g618c318a-1jammy [49.0 MB] 2026-02-24T17:23:15.547 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:15.552 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-24T17:23:15.630 INFO:teuthology.orchestra.run.trial120.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-24T17:23:15.631 INFO:teuthology.orchestra.run.trial120.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-24T17:23:15.632 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-24T17:23:15.708 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-24T17:23:15.783 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:15.784 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-24T17:23:15.862 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-24T17:23:15.936 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-24T17:23:16.016 INFO:teuthology.orchestra.run.trial120.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-24T17:23:16.017 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-24T17:23:16.100 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-24T17:23:16.101 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-24T17:23:16.180 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-24T17:23:16.264 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-24T17:23:16.338 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:16.339 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-24T17:23:16.476 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-24T17:23:16.549 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:16.550 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-24T17:23:16.636 INFO:teuthology.orchestra.run.trial120.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:16.637 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-24T17:23:16.768 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-24T17:23:16.769 INFO:teuthology.orchestra.run.trial120.stdout:Setting up librados2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:16.770 INFO:teuthology.orchestra.run.trial120.stdout:Setting up librgw2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:16.771 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:16.772 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-24T17:23:17.192 INFO:teuthology.orchestra.run.trial040.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5507-g618c318a-1jammy [8626 kB] 2026-02-24T17:23:17.303 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libcephfs2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.305 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libradosstriper1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.306 INFO:teuthology.orchestra.run.trial120.stdout:Setting up librbd1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.306 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-mgr-modules-core (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.307 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.381 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-24T17:23:17.381 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-24T17:23:17.493 INFO:teuthology.orchestra.run.trial040.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5507-g618c318a-1jammy [14.2 kB] 2026-02-24T17:23:17.493 INFO:teuthology.orchestra.run.trial040.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5507-g618c318a-1jammy [65.5 MB] 2026-02-24T17:23:17.786 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libcephfs-dev (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.787 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-rados (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.788 INFO:teuthology.orchestra.run.trial120.stdout:Setting up libcephfs-daemon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.789 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-rbd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.790 INFO:teuthology.orchestra.run.trial120.stdout:Setting up rbd-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.791 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-rgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.792 INFO:teuthology.orchestra.run.trial120.stdout:Setting up python3-cephfs (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.793 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:17.821 INFO:teuthology.orchestra.run.trial120.stdout:Adding group ceph....done 2026-02-24T17:23:17.856 INFO:teuthology.orchestra.run.trial120.stdout:Adding system user ceph....done 2026-02-24T17:23:17.866 INFO:teuthology.orchestra.run.trial120.stdout:Setting system user ceph properties....done 2026-02-24T17:23:17.873 INFO:teuthology.orchestra.run.trial120.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-24T17:23:17.959 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-24T17:23:18.257 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-24T17:23:18.649 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-test (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:18.650 INFO:teuthology.orchestra.run.trial120.stdout:Setting up radosgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:18.903 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-24T17:23:18.904 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-24T17:23:19.271 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-base (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:19.367 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-24T17:23:19.720 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-mds (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:19.781 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-24T17:23:19.781 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-24T17:23:19.924 INFO:teuthology.orchestra.run.trial040.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5507-g618c318a-1jammy [136 kB] 2026-02-24T17:23:19.925 INFO:teuthology.orchestra.run.trial040.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5507-g618c318a-1jammy [47.3 kB] 2026-02-24T17:23:19.925 INFO:teuthology.orchestra.run.trial040.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5507-g618c318a-1jammy [33.1 kB] 2026-02-24T17:23:19.925 INFO:teuthology.orchestra.run.trial040.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5507-g618c318a-1jammy [44.2 kB] 2026-02-24T17:23:19.926 INFO:teuthology.orchestra.run.trial040.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5507-g618c318a-1jammy [18.4 MB] 2026-02-24T17:23:20.135 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-mgr (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:20.214 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-24T17:23:20.214 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-24T17:23:20.570 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:20.571 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-osd-classic (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:20.588 INFO:teuthology.orchestra.run.trial120.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-24T17:23:20.598 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:20.608 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-mon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:20.633 INFO:teuthology.orchestra.run.trial040.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5507-g618c318a-1jammy [93.7 kB] 2026-02-24T17:23:20.678 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-24T17:23:20.678 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-24T17:23:20.914 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 693 MB in 1min 2s (11.2 MB/s) 2026-02-24T17:23:20.930 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-24T17:23:21.067 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-mgr-cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.079 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-mgr-dashboard (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.090 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-osd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.094 INFO:teuthology.orchestra.run.trial040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 202926 files and directories currently installed.) 2026-02-24T17:23:21.098 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-24T17:23:21.099 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-24T17:23:21.121 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-24T17:23:21.136 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-24T17:23:21.136 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-24T17:23:21.152 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-24T17:23:21.164 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-24T17:23:21.164 INFO:teuthology.orchestra.run.trial120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-24T17:23:21.166 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-24T17:23:21.166 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-24T17:23:21.185 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-24T17:23:21.196 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:21.201 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:21.232 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-24T17:23:21.242 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:21.243 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:21.260 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-24T17:23:21.270 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:21.271 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:21.292 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-24T17:23:21.302 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-24T17:23:21.303 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-24T17:23:21.319 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librados2. 2026-02-24T17:23:21.329 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../07-librados2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.330 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librados2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.373 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libnbd0. 2026-02-24T17:23:21.383 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-24T17:23:21.383 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-24T17:23:21.398 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librbd1. 2026-02-24T17:23:21.408 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../09-librbd1_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.409 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librbd1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.447 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libcephfs2. 2026-02-24T17:23:21.457 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.458 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libcephfs2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.478 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-rados. 2026-02-24T17:23:21.488 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.489 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-rados (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.506 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-24T17:23:21.517 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:21.517 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-ceph-argparse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.531 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-cephfs. 2026-02-24T17:23:21.537 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.538 INFO:teuthology.orchestra.run.trial120.stdout:Setting up ceph-volume (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.542 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.543 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-cephfs (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.559 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-24T17:23:21.569 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:21.570 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.587 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-24T17:23:21.598 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-24T17:23:21.598 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-24T17:23:21.615 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-prettytable. 2026-02-24T17:23:21.625 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-24T17:23:21.625 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-24T17:23:21.641 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-rbd. 2026-02-24T17:23:21.648 INFO:teuthology.orchestra.run.trial120.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-24T17:23:21.650 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.651 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-rbd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.668 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-24T17:23:21.679 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-24T17:23:21.679 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-24T17:23:21.698 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librgw2. 2026-02-24T17:23:21.708 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../19-librgw2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.708 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librgw2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.735 INFO:teuthology.orchestra.run.trial120.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-24T17:23:21.806 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-rgw. 2026-02-24T17:23:21.816 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.817 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-rgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.833 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-24T17:23:21.843 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-24T17:23:21.843 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-24T17:23:21.859 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libradosstriper1. 2026-02-24T17:23:21.869 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.869 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libradosstriper1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:21.887 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-common. 2026-02-24T17:23:21.897 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:21.897 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:22.161 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-base. 2026-02-24T17:23:22.171 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:22.176 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-base (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:22.191 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:23:22.191 INFO:teuthology.orchestra.run.trial120.stdout:Running kernel seems to be up-to-date. 2026-02-24T17:23:22.191 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:23:22.191 INFO:teuthology.orchestra.run.trial120.stdout:The processor microcode seems to be up-to-date. 2026-02-24T17:23:22.192 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:23:22.192 INFO:teuthology.orchestra.run.trial120.stdout:No services need to be restarted. 2026-02-24T17:23:22.192 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:23:22.192 INFO:teuthology.orchestra.run.trial120.stdout:No containers need to be restarted. 2026-02-24T17:23:22.192 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:23:22.192 INFO:teuthology.orchestra.run.trial120.stdout:No user sessions are running outdated binaries. 2026-02-24T17:23:22.192 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:23:22.192 INFO:teuthology.orchestra.run.trial120.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-24T17:23:22.236 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-24T17:23:22.247 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-24T17:23:22.247 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-24T17:23:22.262 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-cheroot. 2026-02-24T17:23:22.272 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-24T17:23:22.273 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-24T17:23:22.291 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-24T17:23:22.302 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-24T17:23:22.302 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-24T17:23:22.317 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-24T17:23:22.327 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-24T17:23:22.327 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-24T17:23:22.343 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-24T17:23:22.354 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-24T17:23:22.354 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-24T17:23:22.369 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-tempora. 2026-02-24T17:23:22.379 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-24T17:23:22.379 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-24T17:23:22.394 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-portend. 2026-02-24T17:23:22.405 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-24T17:23:22.406 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-24T17:23:22.421 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-24T17:23:22.431 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-24T17:23:22.432 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-24T17:23:22.448 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-24T17:23:22.458 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-24T17:23:22.458 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-24T17:23:22.482 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-natsort. 2026-02-24T17:23:22.493 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-24T17:23:22.493 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-24T17:23:22.509 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-24T17:23:22.520 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:22.520 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:22.551 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-24T17:23:22.561 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:22.561 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:22.577 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr. 2026-02-24T17:23:22.588 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:22.589 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:22.609 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mon. 2026-02-24T17:23:22.619 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:22.620 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:22.685 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-24T17:23:22.696 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-24T17:23:22.696 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-24T17:23:22.712 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-24T17:23:22.722 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:22.723 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-osd-classic (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:23.002 INFO:teuthology.orchestra.run.trial120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-24T17:23:23.006 DEBUG:teuthology.parallel:result is None 2026-02-24T17:23:26.703 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-osd. 2026-02-24T17:23:26.718 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:26.719 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-osd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:26.738 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph. 2026-02-24T17:23:26.752 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../42-ceph_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:26.752 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:26.769 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-fuse. 2026-02-24T17:23:26.783 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:26.784 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:26.806 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mds. 2026-02-24T17:23:26.817 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:26.817 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mds (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:26.852 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package cephadm. 2026-02-24T17:23:26.863 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../45-cephadm_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:26.863 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:26.880 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-24T17:23:26.891 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-24T17:23:26.891 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:26.913 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-24T17:23:26.923 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:26.923 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:26.945 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-24T17:23:26.956 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-24T17:23:26.956 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-24T17:23:26.972 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-routes. 2026-02-24T17:23:26.982 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-24T17:23:26.983 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-24T17:23:27.004 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-24T17:23:27.013 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:27.014 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:27.564 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-24T17:23:27.575 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-24T17:23:27.576 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-24T17:23:27.614 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-joblib. 2026-02-24T17:23:27.625 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-24T17:23:27.625 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-24T17:23:27.653 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-24T17:23:27.664 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-24T17:23:27.664 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-24T17:23:27.680 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-sklearn. 2026-02-24T17:23:27.691 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-24T17:23:27.691 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-24T17:23:27.773 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-24T17:23:27.784 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:27.784 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:27.944 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-cachetools. 2026-02-24T17:23:27.956 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-24T17:23:27.956 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-24T17:23:27.972 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-rsa. 2026-02-24T17:23:27.982 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-24T17:23:27.983 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-24T17:23:28.001 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-google-auth. 2026-02-24T17:23:28.012 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-24T17:23:28.012 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-24T17:23:28.030 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-24T17:23:28.041 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-24T17:23:28.041 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-24T17:23:28.057 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-websocket. 2026-02-24T17:23:28.067 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-24T17:23:28.068 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-24T17:23:28.086 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-24T17:23:28.097 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-24T17:23:28.097 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-24T17:23:28.193 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-24T17:23:28.204 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:28.205 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:28.219 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-24T17:23:28.230 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-24T17:23:28.230 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-24T17:23:28.247 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-24T17:23:28.257 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-24T17:23:28.258 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:28.273 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package jq. 2026-02-24T17:23:28.284 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-24T17:23:28.285 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:28.300 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package socat. 2026-02-24T17:23:28.310 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-24T17:23:28.310 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-24T17:23:28.331 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package xmlstarlet. 2026-02-24T17:23:28.342 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-24T17:23:28.342 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-24T17:23:28.378 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-test. 2026-02-24T17:23:28.388 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:28.388 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-test (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:29.024 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-volume. 2026-02-24T17:23:29.035 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:29.035 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-volume (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:29.059 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-24T17:23:29.070 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:29.070 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libcephfs-daemon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:29.086 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-24T17:23:29.097 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:29.097 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libcephfs-proxy2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:29.112 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-24T17:23:29.123 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:29.123 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libcephfs-dev (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:29.140 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package nvme-cli. 2026-02-24T17:23:29.150 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-24T17:23:29.150 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-24T17:23:29.181 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-24T17:23:29.192 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-24T17:23:29.192 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:29.221 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-24T17:23:29.232 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-24T17:23:29.232 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-24T17:23:29.248 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pluggy. 2026-02-24T17:23:29.258 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-24T17:23:29.258 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-24T17:23:29.276 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-psutil. 2026-02-24T17:23:29.286 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-24T17:23:29.286 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-24T17:23:29.306 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-py. 2026-02-24T17:23:29.317 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-24T17:23:29.317 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-24T17:23:29.338 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pygments. 2026-02-24T17:23:29.348 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-24T17:23:29.349 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-24T17:23:29.392 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-toml. 2026-02-24T17:23:29.403 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-24T17:23:29.403 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-24T17:23:29.419 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pytest. 2026-02-24T17:23:29.429 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-24T17:23:29.429 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-24T17:23:29.452 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-simplejson. 2026-02-24T17:23:29.463 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-24T17:23:29.464 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-24T17:23:29.488 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-webob. 2026-02-24T17:23:29.498 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-24T17:23:29.499 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-24T17:23:29.516 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-24T17:23:29.527 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-24T17:23:29.528 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-24T17:23:29.596 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package radosgw. 2026-02-24T17:23:29.606 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../85-radosgw_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:29.607 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking radosgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:29.768 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package rbd-fuse. 2026-02-24T17:23:29.779 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:29.780 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking rbd-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:29.808 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-24T17:23:29.875 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-24T17:23:29.876 INFO:teuthology.orchestra.run.trial040.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-24T17:23:29.941 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T17:23:30.214 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-24T17:23:30.575 INFO:teuthology.orchestra.run.trial040.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-24T17:23:30.584 INFO:teuthology.orchestra.run.trial040.stdout:Setting up cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:30.628 INFO:teuthology.orchestra.run.trial040.stdout:Adding system user cephadm....done 2026-02-24T17:23:30.634 INFO:teuthology.orchestra.run.trial040.stdout:usermod: no changes 2026-02-24T17:23:30.640 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-24T17:23:30.711 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:30.712 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-24T17:23:30.776 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-24T17:23:30.842 INFO:teuthology.orchestra.run.trial040.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-24T17:23:30.843 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-24T17:23:30.936 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-24T17:23:31.051 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-24T17:23:31.117 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-24T17:23:31.189 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-ceph-argparse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:31.256 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-24T17:23:31.256 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-24T17:23:31.258 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-24T17:23:31.258 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-24T17:23:31.259 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-24T17:23:31.374 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-24T17:23:31.444 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libcephfs-proxy2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:31.445 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-24T17:23:31.513 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-24T17:23:31.595 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-24T17:23:31.848 INFO:teuthology.orchestra.run.trial040.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-24T17:23:31.849 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-24T17:23:31.946 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:32.073 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-24T17:23:32.158 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-24T17:23:32.222 INFO:teuthology.orchestra.run.trial040.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-24T17:23:32.223 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:32.316 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-24T17:23:32.832 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:32.837 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-24T17:23:32.905 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-24T17:23:32.906 INFO:teuthology.orchestra.run.trial040.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-24T17:23:32.907 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-24T17:23:32.974 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-24T17:23:33.038 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:33.039 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-24T17:23:33.107 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-24T17:23:33.173 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-24T17:23:33.241 INFO:teuthology.orchestra.run.trial040.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-24T17:23:33.242 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-24T17:23:33.317 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-24T17:23:33.318 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-24T17:23:33.387 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-24T17:23:33.472 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-24T17:23:33.537 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:33.538 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-24T17:23:33.666 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-24T17:23:33.739 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:33.740 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-24T17:23:33.815 INFO:teuthology.orchestra.run.trial040.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:33.816 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-24T17:23:33.940 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-24T17:23:33.940 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librados2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:33.941 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librgw2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:33.942 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:33.943 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-24T17:23:34.470 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libcephfs2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.471 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libradosstriper1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.472 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librbd1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.473 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-modules-core (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.474 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.543 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-24T17:23:34.543 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-24T17:23:34.917 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libcephfs-dev (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.918 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-rados (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.919 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libcephfs-daemon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.920 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-rbd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.920 INFO:teuthology.orchestra.run.trial040.stdout:Setting up rbd-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.921 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-rgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.922 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-cephfs (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.923 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:34.952 INFO:teuthology.orchestra.run.trial040.stdout:Adding group ceph....done 2026-02-24T17:23:34.989 INFO:teuthology.orchestra.run.trial040.stdout:Adding system user ceph....done 2026-02-24T17:23:34.999 INFO:teuthology.orchestra.run.trial040.stdout:Setting system user ceph properties....done 2026-02-24T17:23:35.005 INFO:teuthology.orchestra.run.trial040.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-24T17:23:35.094 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-24T17:23:35.363 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-24T17:23:35.718 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-test (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:35.719 INFO:teuthology.orchestra.run.trial040.stdout:Setting up radosgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:35.965 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-24T17:23:35.965 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-24T17:23:36.328 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-base (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:36.409 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-24T17:23:36.783 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mds (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:36.845 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-24T17:23:36.845 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-24T17:23:37.202 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:37.282 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-24T17:23:37.282 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-24T17:23:37.640 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:37.641 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-osd-classic (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:37.658 INFO:teuthology.orchestra.run.trial040.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-24T17:23:37.668 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:37.678 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:37.751 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-24T17:23:37.751 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-24T17:23:38.105 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:38.116 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-dashboard (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:38.127 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-osd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:38.212 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-24T17:23:38.212 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-24T17:23:38.621 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:38.622 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-volume (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:38.734 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-24T17:23:38.819 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-24T17:23:39.502 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:23:39.502 INFO:teuthology.orchestra.run.trial040.stdout:Running kernel seems to be up-to-date. 2026-02-24T17:23:39.502 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:23:39.503 INFO:teuthology.orchestra.run.trial040.stdout:The processor microcode seems to be up-to-date. 2026-02-24T17:23:39.503 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:23:39.503 INFO:teuthology.orchestra.run.trial040.stdout:No services need to be restarted. 2026-02-24T17:23:39.503 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:23:39.503 INFO:teuthology.orchestra.run.trial040.stdout:No containers need to be restarted. 2026-02-24T17:23:39.503 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:23:39.503 INFO:teuthology.orchestra.run.trial040.stdout:No user sessions are running outdated binaries. 2026-02-24T17:23:39.503 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:23:39.504 INFO:teuthology.orchestra.run.trial040.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-24T17:23:40.318 INFO:teuthology.orchestra.run.trial040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-24T17:23:40.325 DEBUG:teuthology.parallel:result is None 2026-02-24T17:23:42.228 INFO:teuthology.orchestra.run.trial109.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5507-g618c318a-1jammy [180 kB] 2026-02-24T17:23:42.229 INFO:teuthology.orchestra.run.trial109.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5507-g618c318a-1jammy [14.1 kB] 2026-02-24T17:23:42.229 INFO:teuthology.orchestra.run.trial109.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5507-g618c318a-1jammy [1030 kB] 2026-02-24T17:23:42.234 INFO:teuthology.orchestra.run.trial109.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5507-g618c318a-1jammy [2437 kB] 2026-02-24T17:23:42.393 INFO:teuthology.orchestra.run.trial109.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5507-g618c318a-1jammy [1072 kB] 2026-02-24T17:23:42.453 INFO:teuthology.orchestra.run.trial109.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5507-g618c318a-1jammy [190 kB] 2026-02-24T17:23:42.496 INFO:teuthology.orchestra.run.trial109.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5507-g618c318a-1jammy [49.0 MB] 2026-02-24T17:23:43.258 INFO:teuthology.orchestra.run.trial094.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5507-g618c318a-1jammy [180 kB] 2026-02-24T17:23:43.267 INFO:teuthology.orchestra.run.trial094.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5507-g618c318a-1jammy [14.1 kB] 2026-02-24T17:23:43.268 INFO:teuthology.orchestra.run.trial094.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5507-g618c318a-1jammy [1030 kB] 2026-02-24T17:23:43.363 INFO:teuthology.orchestra.run.trial094.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5507-g618c318a-1jammy [2437 kB] 2026-02-24T17:23:43.592 INFO:teuthology.orchestra.run.trial094.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5507-g618c318a-1jammy [1072 kB] 2026-02-24T17:23:43.667 INFO:teuthology.orchestra.run.trial094.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5507-g618c318a-1jammy [190 kB] 2026-02-24T17:23:43.709 INFO:teuthology.orchestra.run.trial094.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5507-g618c318a-1jammy [49.0 MB] 2026-02-24T17:23:45.066 INFO:teuthology.orchestra.run.trial109.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5507-g618c318a-1jammy [8626 kB] 2026-02-24T17:23:45.310 INFO:teuthology.orchestra.run.trial109.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5507-g618c318a-1jammy [14.2 kB] 2026-02-24T17:23:45.311 INFO:teuthology.orchestra.run.trial109.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5507-g618c318a-1jammy [65.5 MB] 2026-02-24T17:23:45.850 INFO:teuthology.orchestra.run.trial094.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5507-g618c318a-1jammy [8626 kB] 2026-02-24T17:23:46.152 INFO:teuthology.orchestra.run.trial094.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5507-g618c318a-1jammy [14.2 kB] 2026-02-24T17:23:46.152 INFO:teuthology.orchestra.run.trial094.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5507-g618c318a-1jammy [65.5 MB] 2026-02-24T17:23:47.331 INFO:teuthology.orchestra.run.trial109.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5507-g618c318a-1jammy [136 kB] 2026-02-24T17:23:47.332 INFO:teuthology.orchestra.run.trial109.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5507-g618c318a-1jammy [47.3 kB] 2026-02-24T17:23:47.333 INFO:teuthology.orchestra.run.trial109.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5507-g618c318a-1jammy [33.1 kB] 2026-02-24T17:23:47.334 INFO:teuthology.orchestra.run.trial109.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5507-g618c318a-1jammy [44.2 kB] 2026-02-24T17:23:47.335 INFO:teuthology.orchestra.run.trial109.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5507-g618c318a-1jammy [18.4 MB] 2026-02-24T17:23:47.897 INFO:teuthology.orchestra.run.trial109.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5507-g618c318a-1jammy [93.7 kB] 2026-02-24T17:23:48.152 INFO:teuthology.orchestra.run.trial094.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5507-g618c318a-1jammy [136 kB] 2026-02-24T17:23:48.153 INFO:teuthology.orchestra.run.trial094.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5507-g618c318a-1jammy [47.3 kB] 2026-02-24T17:23:48.153 INFO:teuthology.orchestra.run.trial094.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5507-g618c318a-1jammy [33.1 kB] 2026-02-24T17:23:48.153 INFO:teuthology.orchestra.run.trial094.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5507-g618c318a-1jammy [44.2 kB] 2026-02-24T17:23:48.153 INFO:teuthology.orchestra.run.trial094.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5507-g618c318a-1jammy [18.4 MB] 2026-02-24T17:23:48.175 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 693 MB in 1min 29s (7759 kB/s) 2026-02-24T17:23:48.191 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-24T17:23:48.360 INFO:teuthology.orchestra.run.trial109.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 202926 files and directories currently installed.) 2026-02-24T17:23:48.363 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-24T17:23:48.364 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-24T17:23:48.388 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-24T17:23:48.404 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-24T17:23:48.404 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-24T17:23:48.421 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-24T17:23:48.435 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-24T17:23:48.435 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-24T17:23:48.450 INFO:teuthology.orchestra.run.trial094.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2026-02-23-2128/618c318a7a0b287ab5aeff207b7bf1d73ef45044/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5507-g618c318a-1jammy [93.7 kB] 2026-02-24T17:23:48.453 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-24T17:23:48.467 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:48.473 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:48.505 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-24T17:23:48.515 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:48.515 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:48.533 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-24T17:23:48.543 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:48.543 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:48.564 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-24T17:23:48.574 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-24T17:23:48.575 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-24T17:23:48.593 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librados2. 2026-02-24T17:23:48.602 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../07-librados2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:48.603 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librados2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.645 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libnbd0. 2026-02-24T17:23:48.655 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-24T17:23:48.656 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-24T17:23:48.670 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librbd1. 2026-02-24T17:23:48.680 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../09-librbd1_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:48.680 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librbd1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.718 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs2. 2026-02-24T17:23:48.728 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:48.729 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.732 INFO:teuthology.orchestra.run.trial094.stdout:Fetched 693 MB in 1min 30s (7709 kB/s) 2026-02-24T17:23:48.749 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rados. 2026-02-24T17:23:48.749 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-24T17:23:48.758 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:48.759 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rados (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.777 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-24T17:23:48.787 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:48.788 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-ceph-argparse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.802 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cephfs. 2026-02-24T17:23:48.812 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:48.812 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cephfs (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.829 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-24T17:23:48.839 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:48.839 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.858 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-24T17:23:48.868 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-24T17:23:48.868 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-24T17:23:48.884 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-prettytable. 2026-02-24T17:23:48.894 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-24T17:23:48.895 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-24T17:23:48.910 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rbd. 2026-02-24T17:23:48.918 INFO:teuthology.orchestra.run.trial094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 202926 files and directories currently installed.) 2026-02-24T17:23:48.920 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:48.920 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-24T17:23:48.921 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rbd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.921 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-24T17:23:48.939 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-24T17:23:48.944 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-24T17:23:48.949 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-24T17:23:48.950 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-24T17:23:48.959 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-24T17:23:48.960 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-24T17:23:48.969 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librgw2. 2026-02-24T17:23:48.977 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-24T17:23:48.979 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../19-librgw2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:48.979 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librgw2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:48.991 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-24T17:23:48.992 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-24T17:23:49.009 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-24T17:23:49.019 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:49.024 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:49.057 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-24T17:23:49.067 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:49.068 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:49.080 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rgw. 2026-02-24T17:23:49.085 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-24T17:23:49.090 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.090 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.094 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-24T17:23:49.095 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:23:49.106 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-24T17:23:49.116 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-24T17:23:49.117 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-24T17:23:49.117 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-24T17:23:49.126 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-24T17:23:49.126 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-24T17:23:49.132 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libradosstriper1. 2026-02-24T17:23:49.142 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.142 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package librados2. 2026-02-24T17:23:49.142 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libradosstriper1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.152 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../07-librados2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.152 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking librados2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.159 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-common. 2026-02-24T17:23:49.168 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.169 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.197 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libnbd0. 2026-02-24T17:23:49.207 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-24T17:23:49.207 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-24T17:23:49.222 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package librbd1. 2026-02-24T17:23:49.232 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../09-librbd1_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.232 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking librbd1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.272 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libcephfs2. 2026-02-24T17:23:49.282 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.282 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libcephfs2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.302 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-rados. 2026-02-24T17:23:49.312 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.312 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-rados (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.330 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-24T17:23:49.341 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:49.341 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-ceph-argparse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.356 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-cephfs. 2026-02-24T17:23:49.366 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.366 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-cephfs (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.383 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-24T17:23:49.393 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:49.393 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.412 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-24T17:23:49.422 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-24T17:23:49.423 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-24T17:23:49.439 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-prettytable. 2026-02-24T17:23:49.449 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-24T17:23:49.449 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-24T17:23:49.464 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-rbd. 2026-02-24T17:23:49.474 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.475 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-rbd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.492 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-24T17:23:49.502 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-24T17:23:49.503 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-24T17:23:49.503 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-base. 2026-02-24T17:23:49.514 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.518 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-base (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.521 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package librgw2. 2026-02-24T17:23:49.531 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../19-librgw2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.532 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking librgw2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.579 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-24T17:23:49.590 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-24T17:23:49.591 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-24T17:23:49.606 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cheroot. 2026-02-24T17:23:49.617 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-24T17:23:49.617 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-24T17:23:49.629 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-rgw. 2026-02-24T17:23:49.635 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-24T17:23:49.639 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.640 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-rgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.645 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-24T17:23:49.646 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-24T17:23:49.656 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-24T17:23:49.661 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-24T17:23:49.666 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-24T17:23:49.666 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-24T17:23:49.671 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-24T17:23:49.672 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-24T17:23:49.682 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libradosstriper1. 2026-02-24T17:23:49.688 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-24T17:23:49.692 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.693 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libradosstriper1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.698 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-24T17:23:49.698 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-24T17:23:49.710 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-common. 2026-02-24T17:23:49.713 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-tempora. 2026-02-24T17:23:49.720 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.720 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.723 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-24T17:23:49.723 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-24T17:23:49.740 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-portend. 2026-02-24T17:23:49.750 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-24T17:23:49.750 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-24T17:23:49.765 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-24T17:23:49.775 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-24T17:23:49.776 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-24T17:23:49.791 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-24T17:23:49.801 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-24T17:23:49.801 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-24T17:23:49.827 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-natsort. 2026-02-24T17:23:49.837 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-24T17:23:49.838 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-24T17:23:49.854 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-24T17:23:49.864 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:49.864 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.895 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-24T17:23:49.904 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.905 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.921 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr. 2026-02-24T17:23:49.931 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.931 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.953 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mon. 2026-02-24T17:23:49.963 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:49.964 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:49.985 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-base. 2026-02-24T17:23:49.995 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:50.000 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-base (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:50.028 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-24T17:23:50.038 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-24T17:23:50.038 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-24T17:23:50.055 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-24T17:23:50.062 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-24T17:23:50.065 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:50.065 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-osd-classic (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:50.073 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-24T17:23:50.073 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-24T17:23:50.089 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-cheroot. 2026-02-24T17:23:50.099 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-24T17:23:50.100 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-24T17:23:50.117 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-24T17:23:50.127 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-24T17:23:50.128 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-24T17:23:50.142 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-24T17:23:50.153 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-24T17:23:50.153 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-24T17:23:50.168 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-24T17:23:50.178 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-24T17:23:50.178 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-24T17:23:50.193 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-tempora. 2026-02-24T17:23:50.203 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-24T17:23:50.203 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-24T17:23:50.218 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-portend. 2026-02-24T17:23:50.229 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-24T17:23:50.229 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-24T17:23:50.244 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-24T17:23:50.254 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-24T17:23:50.254 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-24T17:23:50.269 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-24T17:23:50.280 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-24T17:23:50.280 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-24T17:23:50.305 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-natsort. 2026-02-24T17:23:50.315 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-24T17:23:50.315 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-24T17:23:50.332 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-24T17:23:50.342 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:50.342 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:50.372 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-24T17:23:50.382 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:50.382 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:50.399 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-mgr. 2026-02-24T17:23:50.409 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:50.409 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-mgr (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:50.430 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-mon. 2026-02-24T17:23:50.440 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:50.441 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-mon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:50.507 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-24T17:23:50.517 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-24T17:23:50.518 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-24T17:23:50.534 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-24T17:23:50.544 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:50.544 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-osd-classic (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:53.970 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-osd. 2026-02-24T17:23:53.985 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:53.986 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-osd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.005 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph. 2026-02-24T17:23:54.020 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../42-ceph_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.020 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.037 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-fuse. 2026-02-24T17:23:54.052 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.053 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.077 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mds. 2026-02-24T17:23:54.089 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.089 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mds (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.121 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package cephadm. 2026-02-24T17:23:54.132 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../45-cephadm_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.132 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.149 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-24T17:23:54.159 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-24T17:23:54.159 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:54.182 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-24T17:23:54.193 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:54.193 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.215 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-24T17:23:54.224 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-24T17:23:54.225 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-24T17:23:54.239 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-routes. 2026-02-24T17:23:54.249 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-24T17:23:54.250 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-24T17:23:54.271 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-24T17:23:54.281 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:54.281 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.409 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-osd. 2026-02-24T17:23:54.425 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.426 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-osd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.445 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph. 2026-02-24T17:23:54.460 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../42-ceph_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.460 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.478 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-fuse. 2026-02-24T17:23:54.492 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.492 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.518 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-mds. 2026-02-24T17:23:54.530 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.530 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-mds (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.571 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package cephadm. 2026-02-24T17:23:54.581 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../45-cephadm_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:54.581 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.598 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-24T17:23:54.608 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-24T17:23:54.608 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:54.630 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-24T17:23:54.640 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:54.640 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.662 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-24T17:23:54.672 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-24T17:23:54.673 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-24T17:23:54.689 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-routes. 2026-02-24T17:23:54.699 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-24T17:23:54.699 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-24T17:23:54.720 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-24T17:23:54.730 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:54.730 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:54.831 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-24T17:23:54.842 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-24T17:23:54.843 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-24T17:23:54.885 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-joblib. 2026-02-24T17:23:54.895 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-24T17:23:54.895 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-24T17:23:54.923 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-24T17:23:54.933 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-24T17:23:54.933 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-24T17:23:54.949 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-sklearn. 2026-02-24T17:23:54.959 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-24T17:23:54.960 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-24T17:23:55.042 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-24T17:23:55.053 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:55.054 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:55.218 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cachetools. 2026-02-24T17:23:55.229 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-24T17:23:55.230 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-24T17:23:55.245 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rsa. 2026-02-24T17:23:55.255 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-24T17:23:55.255 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-24T17:23:55.273 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-24T17:23:55.275 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-google-auth. 2026-02-24T17:23:55.285 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-24T17:23:55.285 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-24T17:23:55.286 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-24T17:23:55.286 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-24T17:23:55.305 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-24T17:23:55.315 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-24T17:23:55.315 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-24T17:23:55.324 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-joblib. 2026-02-24T17:23:55.332 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-websocket. 2026-02-24T17:23:55.334 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-24T17:23:55.335 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-24T17:23:55.342 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-24T17:23:55.342 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-24T17:23:55.361 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-24T17:23:55.363 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-24T17:23:55.372 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-24T17:23:55.372 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-24T17:23:55.374 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-24T17:23:55.374 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-24T17:23:55.390 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-sklearn. 2026-02-24T17:23:55.401 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-24T17:23:55.401 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-24T17:23:55.468 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-24T17:23:55.479 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:55.479 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:55.483 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-24T17:23:55.494 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:55.494 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:55.495 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-24T17:23:55.505 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-24T17:23:55.506 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-24T17:23:55.522 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-24T17:23:55.533 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-24T17:23:55.533 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:55.548 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package jq. 2026-02-24T17:23:55.559 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-24T17:23:55.559 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:55.574 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package socat. 2026-02-24T17:23:55.585 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-24T17:23:55.585 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-24T17:23:55.606 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package xmlstarlet. 2026-02-24T17:23:55.616 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-24T17:23:55.617 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-24T17:23:55.653 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-test. 2026-02-24T17:23:55.654 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-cachetools. 2026-02-24T17:23:55.663 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:55.663 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-test (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:55.665 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-24T17:23:55.665 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-24T17:23:55.680 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-rsa. 2026-02-24T17:23:55.691 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-24T17:23:55.691 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-24T17:23:55.711 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-google-auth. 2026-02-24T17:23:55.723 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-24T17:23:55.723 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-24T17:23:55.741 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-24T17:23:55.751 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-24T17:23:55.752 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-24T17:23:55.768 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-websocket. 2026-02-24T17:23:55.779 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-24T17:23:55.779 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-24T17:23:55.797 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-24T17:23:55.808 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-24T17:23:55.808 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-24T17:23:55.906 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-24T17:23:55.917 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:55.917 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:55.932 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-24T17:23:55.943 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-24T17:23:55.943 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-24T17:23:55.960 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-24T17:23:55.971 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-24T17:23:55.972 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:55.988 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package jq. 2026-02-24T17:23:55.998 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-24T17:23:55.998 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-24T17:23:56.014 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package socat. 2026-02-24T17:23:56.024 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-24T17:23:56.025 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-24T17:23:56.045 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package xmlstarlet. 2026-02-24T17:23:56.056 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-24T17:23:56.056 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-24T17:23:56.094 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-test. 2026-02-24T17:23:56.104 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:56.104 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-test (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.272 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-volume. 2026-02-24T17:23:56.283 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:56.283 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-volume (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.307 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-24T17:23:56.318 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:56.318 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs-daemon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.333 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-24T17:23:56.343 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:56.344 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs-proxy2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.359 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-24T17:23:56.370 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:56.370 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs-dev (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.386 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package nvme-cli. 2026-02-24T17:23:56.396 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-24T17:23:56.397 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-24T17:23:56.432 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-24T17:23:56.442 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-24T17:23:56.442 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:56.473 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-24T17:23:56.483 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-24T17:23:56.483 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-24T17:23:56.499 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pluggy. 2026-02-24T17:23:56.509 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-24T17:23:56.510 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-24T17:23:56.527 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-psutil. 2026-02-24T17:23:56.537 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-24T17:23:56.537 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-24T17:23:56.557 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-py. 2026-02-24T17:23:56.567 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-24T17:23:56.568 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-24T17:23:56.588 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pygments. 2026-02-24T17:23:56.598 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-24T17:23:56.598 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-24T17:23:56.643 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-toml. 2026-02-24T17:23:56.653 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-24T17:23:56.654 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-24T17:23:56.669 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pytest. 2026-02-24T17:23:56.679 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-24T17:23:56.680 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-24T17:23:56.702 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-simplejson. 2026-02-24T17:23:56.713 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-24T17:23:56.713 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-24T17:23:56.739 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-webob. 2026-02-24T17:23:56.749 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-24T17:23:56.750 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-24T17:23:56.754 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package ceph-volume. 2026-02-24T17:23:56.765 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5507-g618c318a-1jammy_all.deb ... 2026-02-24T17:23:56.765 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking ceph-volume (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.767 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-24T17:23:56.777 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-24T17:23:56.777 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-24T17:23:56.788 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-24T17:23:56.799 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:56.799 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libcephfs-daemon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.815 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-24T17:23:56.826 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:56.826 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libcephfs-proxy2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.842 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-24T17:23:56.845 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package radosgw. 2026-02-24T17:23:56.852 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:56.852 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking libcephfs-dev (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.857 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../85-radosgw_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:56.857 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking radosgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:56.870 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package nvme-cli. 2026-02-24T17:23:56.881 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-24T17:23:56.881 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-24T17:23:56.914 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-24T17:23:56.925 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-24T17:23:56.925 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:56.955 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-24T17:23:56.966 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-24T17:23:56.966 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-24T17:23:56.983 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-pluggy. 2026-02-24T17:23:56.993 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-24T17:23:56.994 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-24T17:23:57.010 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-psutil. 2026-02-24T17:23:57.020 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-24T17:23:57.021 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-24T17:23:57.025 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package rbd-fuse. 2026-02-24T17:23:57.036 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:57.037 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking rbd-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:57.040 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-py. 2026-02-24T17:23:57.050 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-24T17:23:57.050 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-24T17:23:57.066 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-24T17:23:57.072 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-pygments. 2026-02-24T17:23:57.082 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-24T17:23:57.083 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-24T17:23:57.125 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-toml. 2026-02-24T17:23:57.131 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-24T17:23:57.133 INFO:teuthology.orchestra.run.trial109.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-24T17:23:57.135 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-24T17:23:57.135 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-24T17:23:57.151 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-pytest. 2026-02-24T17:23:57.161 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-24T17:23:57.162 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-24T17:23:57.185 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-simplejson. 2026-02-24T17:23:57.195 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-24T17:23:57.195 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-24T17:23:57.206 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T17:23:57.221 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package python3-webob. 2026-02-24T17:23:57.232 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-24T17:23:57.232 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-24T17:23:57.250 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-24T17:23:57.260 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-24T17:23:57.261 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-24T17:23:57.329 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package radosgw. 2026-02-24T17:23:57.341 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../85-radosgw_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:57.341 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking radosgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:57.491 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-24T17:23:57.508 INFO:teuthology.orchestra.run.trial094.stdout:Selecting previously unselected package rbd-fuse. 2026-02-24T17:23:57.519 INFO:teuthology.orchestra.run.trial094.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5507-g618c318a-1jammy_amd64.deb ... 2026-02-24T17:23:57.519 INFO:teuthology.orchestra.run.trial094.stdout:Unpacking rbd-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:57.548 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-24T17:23:57.616 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-24T17:23:57.617 INFO:teuthology.orchestra.run.trial094.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-24T17:23:57.689 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T17:23:57.876 INFO:teuthology.orchestra.run.trial109.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-24T17:23:57.886 INFO:teuthology.orchestra.run.trial109.stdout:Setting up cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:57.930 INFO:teuthology.orchestra.run.trial109.stdout:Adding system user cephadm....done 2026-02-24T17:23:57.936 INFO:teuthology.orchestra.run.trial109.stdout:usermod: no changes 2026-02-24T17:23:57.940 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-24T17:23:57.951 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-24T17:23:58.011 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:58.012 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-24T17:23:58.084 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-24T17:23:58.159 INFO:teuthology.orchestra.run.trial109.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-24T17:23:58.160 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-24T17:23:58.255 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-24T17:23:58.313 INFO:teuthology.orchestra.run.trial094.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-24T17:23:58.324 INFO:teuthology.orchestra.run.trial094.stdout:Setting up cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:58.369 INFO:teuthology.orchestra.run.trial094.stdout:Adding system user cephadm....done 2026-02-24T17:23:58.376 INFO:teuthology.orchestra.run.trial094.stdout:usermod: no changes 2026-02-24T17:23:58.379 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-24T17:23:58.381 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-24T17:23:58.453 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:58.454 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-24T17:23:58.454 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-24T17:23:58.525 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-24T17:23:58.528 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-ceph-argparse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:58.594 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-24T17:23:58.595 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-24T17:23:58.596 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-24T17:23:58.597 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-24T17:23:58.598 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-24T17:23:58.599 INFO:teuthology.orchestra.run.trial094.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-24T17:23:58.600 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-24T17:23:58.696 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-24T17:23:58.722 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-24T17:23:58.801 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs-proxy2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:58.802 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-24T17:23:58.820 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-24T17:23:58.882 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-24T17:23:58.894 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-24T17:23:58.970 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-ceph-argparse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:58.971 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-24T17:23:59.038 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-24T17:23:59.039 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-24T17:23:59.040 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-24T17:23:59.041 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-24T17:23:59.042 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-24T17:23:59.167 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-24T17:23:59.226 INFO:teuthology.orchestra.run.trial109.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-24T17:23:59.227 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-24T17:23:59.246 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libcephfs-proxy2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:59.247 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-24T17:23:59.323 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:59.326 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-24T17:23:59.415 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-24T17:23:59.449 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-24T17:23:59.530 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-24T17:23:59.600 INFO:teuthology.orchestra.run.trial109.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-24T17:23:59.601 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:23:59.673 INFO:teuthology.orchestra.run.trial094.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-24T17:23:59.673 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-24T17:23:59.691 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-24T17:23:59.760 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-24T17:23:59.887 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-24T17:23:59.969 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-24T17:24:00.041 INFO:teuthology.orchestra.run.trial094.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-24T17:24:00.042 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:00.137 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-24T17:24:00.201 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:24:00.206 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-24T17:24:00.284 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-24T17:24:00.285 INFO:teuthology.orchestra.run.trial109.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-24T17:24:00.286 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-24T17:24:00.359 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-24T17:24:00.432 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:24:00.433 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-24T17:24:00.513 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-24T17:24:00.589 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-24T17:24:00.649 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:24:00.654 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-24T17:24:00.665 INFO:teuthology.orchestra.run.trial109.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-24T17:24:00.666 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-24T17:24:00.733 INFO:teuthology.orchestra.run.trial094.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-24T17:24:00.734 INFO:teuthology.orchestra.run.trial094.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-24T17:24:00.735 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-24T17:24:00.747 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-24T17:24:00.748 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-24T17:24:00.811 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-24T17:24:00.823 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-24T17:24:00.884 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:24:00.885 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-24T17:24:00.909 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-24T17:24:00.962 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-24T17:24:00.981 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-24T17:24:00.982 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-24T17:24:01.038 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-24T17:24:01.118 INFO:teuthology.orchestra.run.trial094.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-24T17:24:01.118 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-24T17:24:01.119 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-24T17:24:01.192 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:24:01.193 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-24T17:24:01.203 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-24T17:24:01.204 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-24T17:24:01.279 INFO:teuthology.orchestra.run.trial109.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-24T17:24:01.280 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-24T17:24:01.281 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-24T17:24:01.365 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-24T17:24:01.414 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-24T17:24:01.415 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librados2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.416 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librgw2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.417 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.418 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-24T17:24:01.437 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-24T17:24:01.439 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-24T17:24:01.573 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-24T17:24:01.645 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-24T17:24:01.646 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-24T17:24:01.727 INFO:teuthology.orchestra.run.trial094.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-24T17:24:01.728 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-24T17:24:01.864 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-24T17:24:01.865 INFO:teuthology.orchestra.run.trial094.stdout:Setting up librados2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.866 INFO:teuthology.orchestra.run.trial094.stdout:Setting up librgw2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.867 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.868 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-24T17:24:01.946 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.947 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libradosstriper1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.948 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librbd1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.949 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-modules-core (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:01.949 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.023 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-24T17:24:02.023 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-24T17:24:02.400 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libcephfs2 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.401 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libradosstriper1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.402 INFO:teuthology.orchestra.run.trial094.stdout:Setting up librbd1 (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.403 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-mgr-modules-core (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.404 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.438 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs-dev (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.439 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rados (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.439 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs-daemon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.440 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rbd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.441 INFO:teuthology.orchestra.run.trial109.stdout:Setting up rbd-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.442 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.443 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cephfs (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.444 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.472 INFO:teuthology.orchestra.run.trial109.stdout:Adding group ceph....done 2026-02-24T17:24:02.478 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-24T17:24:02.479 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-24T17:24:02.505 INFO:teuthology.orchestra.run.trial109.stdout:Adding system user ceph....done 2026-02-24T17:24:02.515 INFO:teuthology.orchestra.run.trial109.stdout:Setting system user ceph properties....done 2026-02-24T17:24:02.521 INFO:teuthology.orchestra.run.trial109.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-24T17:24:02.609 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-24T17:24:02.863 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libcephfs-dev (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.864 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-rados (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.865 INFO:teuthology.orchestra.run.trial094.stdout:Setting up libcephfs-daemon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.866 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-rbd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.866 INFO:teuthology.orchestra.run.trial094.stdout:Setting up rbd-fuse (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.867 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-rgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.868 INFO:teuthology.orchestra.run.trial094.stdout:Setting up python3-cephfs (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.869 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-common (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:02.887 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-24T17:24:02.896 INFO:teuthology.orchestra.run.trial094.stdout:Adding group ceph....done 2026-02-24T17:24:02.931 INFO:teuthology.orchestra.run.trial094.stdout:Adding system user ceph....done 2026-02-24T17:24:02.942 INFO:teuthology.orchestra.run.trial094.stdout:Setting system user ceph properties....done 2026-02-24T17:24:02.948 INFO:teuthology.orchestra.run.trial094.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-24T17:24:03.035 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-24T17:24:03.282 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-test (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:03.283 INFO:teuthology.orchestra.run.trial109.stdout:Setting up radosgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:03.294 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-24T17:24:03.539 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-24T17:24:03.539 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-24T17:24:03.654 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-test (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:03.655 INFO:teuthology.orchestra.run.trial094.stdout:Setting up radosgw (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:03.907 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-24T17:24:03.907 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-24T17:24:03.932 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-base (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:04.049 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-24T17:24:04.250 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-base (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:04.367 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-24T17:24:04.442 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mds (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:04.502 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-24T17:24:04.502 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-24T17:24:04.715 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-mds (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:04.774 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-24T17:24:04.774 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-24T17:24:04.877 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:04.958 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-24T17:24:04.958 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-24T17:24:05.138 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-mgr (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.207 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-24T17:24:05.207 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-24T17:24:05.357 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.358 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-osd-classic (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.375 INFO:teuthology.orchestra.run.trial109.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-24T17:24:05.385 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.396 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.454 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-24T17:24:05.454 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-24T17:24:05.568 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.569 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-osd-classic (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.586 INFO:teuthology.orchestra.run.trial094.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-24T17:24:05.596 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.606 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-mon (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.677 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-24T17:24:05.677 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-24T17:24:05.861 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.871 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-dashboard (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.882 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-osd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:05.964 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-24T17:24:05.965 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-24T17:24:06.048 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-mgr-cephadm (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:06.059 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-mgr-dashboard (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:06.070 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-osd (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:06.157 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-24T17:24:06.157 INFO:teuthology.orchestra.run.trial094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-24T17:24:06.344 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:06.345 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-volume (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:06.457 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-24T17:24:06.532 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:06.533 INFO:teuthology.orchestra.run.trial094.stdout:Setting up ceph-volume (20.3.0-5507-g618c318a-1jammy) ... 2026-02-24T17:24:06.542 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-24T17:24:06.642 INFO:teuthology.orchestra.run.trial094.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-24T17:24:06.730 INFO:teuthology.orchestra.run.trial094.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-24T17:24:07.183 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:07.184 INFO:teuthology.orchestra.run.trial109.stdout:Running kernel seems to be up-to-date. 2026-02-24T17:24:07.184 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout:The processor microcode seems to be up-to-date. 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout:No services need to be restarted. 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout:No containers need to be restarted. 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout:No user sessions are running outdated binaries. 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:07.185 INFO:teuthology.orchestra.run.trial109.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-24T17:24:07.405 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:07.406 INFO:teuthology.orchestra.run.trial094.stdout:Running kernel seems to be up-to-date. 2026-02-24T17:24:07.406 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:07.406 INFO:teuthology.orchestra.run.trial094.stdout:The processor microcode seems to be up-to-date. 2026-02-24T17:24:07.406 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:07.406 INFO:teuthology.orchestra.run.trial094.stdout:No services need to be restarted. 2026-02-24T17:24:07.406 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:07.407 INFO:teuthology.orchestra.run.trial094.stdout:No containers need to be restarted. 2026-02-24T17:24:07.407 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:07.407 INFO:teuthology.orchestra.run.trial094.stdout:No user sessions are running outdated binaries. 2026-02-24T17:24:07.407 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:07.407 INFO:teuthology.orchestra.run.trial094.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-24T17:24:07.993 INFO:teuthology.orchestra.run.trial109.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-24T17:24:07.997 DEBUG:teuthology.parallel:result is None 2026-02-24T17:24:08.203 INFO:teuthology.orchestra.run.trial094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-24T17:24:08.209 DEBUG:teuthology.parallel:result is None 2026-02-24T17:24:08.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:24:08.369 DEBUG:teuthology.orchestra.run.trial040:> dpkg-query -W -f '${Version}' ceph 2026-02-24T17:24:08.381 INFO:teuthology.orchestra.run.trial040.stdout:20.3.0-5507-g618c318a-1jammy 2026-02-24T17:24:08.381 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:24:08.381 INFO:teuthology.task.install:The correct ceph version 20.3.0-5507-g618c318a-1jammy is installed. 2026-02-24T17:24:08.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:24:08.543 DEBUG:teuthology.orchestra.run.trial094:> dpkg-query -W -f '${Version}' ceph 2026-02-24T17:24:08.551 INFO:teuthology.orchestra.run.trial094.stdout:20.3.0-5507-g618c318a-1jammy 2026-02-24T17:24:08.552 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:24:08.552 INFO:teuthology.task.install:The correct ceph version 20.3.0-5507-g618c318a-1jammy is installed. 2026-02-24T17:24:08.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:24:08.694 DEBUG:teuthology.orchestra.run.trial109:> dpkg-query -W -f '${Version}' ceph 2026-02-24T17:24:08.704 INFO:teuthology.orchestra.run.trial109.stdout:20.3.0-5507-g618c318a-1jammy 2026-02-24T17:24:08.704 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:24:08.704 INFO:teuthology.task.install:The correct ceph version 20.3.0-5507-g618c318a-1jammy is installed. 2026-02-24T17:24:08.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:24:08.842 DEBUG:teuthology.orchestra.run.trial120:> dpkg-query -W -f '${Version}' ceph 2026-02-24T17:24:08.854 INFO:teuthology.orchestra.run.trial120.stdout:20.3.0-5507-g618c318a-1jammy 2026-02-24T17:24:08.854 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5507-g618c318a-1jammy 2026-02-24T17:24:08.854 INFO:teuthology.task.install:The correct ceph version 20.3.0-5507-g618c318a-1jammy is installed. 2026-02-24T17:24:08.856 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T17:24:08.856 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:08.856 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T17:24:08.868 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:08.868 DEBUG:teuthology.orchestra.run.trial094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T17:24:08.877 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:08.877 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T17:24:08.885 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:08.885 DEBUG:teuthology.orchestra.run.trial120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T17:24:08.903 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T17:24:08.904 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:08.904 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T17:24:08.919 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T17:24:08.969 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:08.969 DEBUG:teuthology.orchestra.run.trial094:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T17:24:08.977 DEBUG:teuthology.orchestra.run.trial094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T17:24:09.026 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:09.026 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T17:24:09.036 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T17:24:09.086 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:09.086 DEBUG:teuthology.orchestra.run.trial120:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T17:24:09.096 DEBUG:teuthology.orchestra.run.trial120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T17:24:09.147 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T17:24:09.147 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:09.147 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T17:24:09.159 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T17:24:09.210 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:09.210 DEBUG:teuthology.orchestra.run.trial094:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T17:24:09.218 DEBUG:teuthology.orchestra.run.trial094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T17:24:09.266 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:09.266 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T17:24:09.276 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T17:24:09.326 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:09.327 DEBUG:teuthology.orchestra.run.trial120:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T17:24:09.337 DEBUG:teuthology.orchestra.run.trial120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T17:24:09.386 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T17:24:09.386 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:09.386 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T17:24:09.395 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T17:24:09.446 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:09.446 DEBUG:teuthology.orchestra.run.trial094:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T17:24:09.453 DEBUG:teuthology.orchestra.run.trial094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T17:24:09.502 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:09.503 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T17:24:09.512 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T17:24:09.563 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:09.563 DEBUG:teuthology.orchestra.run.trial120:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T17:24:09.573 DEBUG:teuthology.orchestra.run.trial120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T17:24:09.622 INFO:teuthology.run_tasks:Running task ceph... 2026-02-24T17:24:09.706 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-24T17:24:09.706 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 777 /var/log/ceph 2026-02-24T17:24:09.709 DEBUG:teuthology.orchestra.run.trial094:> sudo chmod 777 /var/log/ceph 2026-02-24T17:24:09.710 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 777 /var/log/ceph 2026-02-24T17:24:09.711 DEBUG:teuthology.orchestra.run.trial120:> sudo chmod 777 /var/log/ceph 2026-02-24T17:24:09.719 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-24T17:24:09.720 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T17:24:09.759 DEBUG:teuthology.orchestra.run.trial094:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T17:24:09.760 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T17:24:09.761 DEBUG:teuthology.orchestra.run.trial120:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T17:24:09.770 INFO:tasks.ceph:Creating extra log directories... 2026-02-24T17:24:09.770 DEBUG:teuthology.orchestra.run.trial040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T17:24:09.808 DEBUG:teuthology.orchestra.run.trial094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T17:24:09.810 DEBUG:teuthology.orchestra.run.trial109:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T17:24:09.811 DEBUG:teuthology.orchestra.run.trial120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T17:24:09.835 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-24T17:24:09.835 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore debug onode segmentation random': True, 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd max scrubs': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mgrc': 20, 'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'mon warn on pool no app': False}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*', 'reached quota', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-24T17:24:09.836 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468', 'branch': 'wip-yuri8-testing-2026-02-23-2128', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/{bluestore/{alloc$/{hybrid} base mem$/{low} onode-segment$/{512K-onoff} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '68468', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2026-02-23-2128'}, 'ceph': {'conf': {'client': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mgrc': 20, 'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore debug onode segmentation random': True, 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd max scrubs': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'crush_tunables': 'jewel', 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*', 'reached quota', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)'], 'sha1': '618c318a7a0b287ab5aeff207b7bf1d73ef45044'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '618c318a7a0b287ab5aeff207b7bf1d73ef45044'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2026-02-23-2128', 'sha1': '618c318a7a0b287ab5aeff207b7bf1d73ef45044'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 6922, 'sha1': '618c318a7a0b287ab5aeff207b7bf1d73ef45044', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri8-testing-2026-02-23-2128', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_618c318a7a0b287ab5aeff207b7bf1d73ef45044/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '618c318a7a0b287ab5aeff207b7bf1d73ef45044', 'targets': {'trial040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLuqOTzP1NO3g8ZDv/vaKjr73ObC3zk/OCly+gxxMZRLjgD/1GD60vGqOMcRim5M74mbn8hFJXJ/dAoxvMXMHzM=', 'trial094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqwYqHkNOLn3ydD/CUc0eNO7GKSmzl2zOTRLEvxdwPzzhsIORCm66PAgXr3wcBCGfO8H0ySW0HAZjDALR6YVVM=', 'trial109.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/1pL8AoWwBWj3DTuH8Cc7gyQzfVgSO2IKdi487aeKKz9bGiEItomtThHltMTBnjD/H1zo3G0VGj8G4EMJ2U2Y=', 'trial120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGjt6UdtOAuqapCEU0dIm5Yh3eQ2o0tX9eURatVkNpz33lhdHppSmyhNIY78UHoofhwWCI6wIh0fxAoyBh1GIE4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore debug onode segmentation random': True, 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd max scrubs': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mgrc': 20, 'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'mon warn on pool no app': False}}, 'crush_tunables': 'jewel', 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*', 'reached quota', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)'], 'sha1': '618c318a7a0b287ab5aeff207b7bf1d73ef45044', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-24_16:03:54', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-24T17:24:09.836 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T17:24:09.855 DEBUG:teuthology.orchestra.run.trial094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T17:24:09.859 DEBUG:teuthology.orchestra.run.trial109:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T17:24:09.860 DEBUG:teuthology.orchestra.run.trial120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T17:24:09.866 DEBUG:teuthology.orchestra.run.trial040:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T17:24:09.899 DEBUG:teuthology.orchestra.run.trial094:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T17:24:09.903 DEBUG:teuthology.orchestra.run.trial109:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T17:24:09.907 DEBUG:teuthology.orchestra.run.trial120:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T17:24:09.914 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:09.914 DEBUG:teuthology.orchestra.run.trial040:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T17:24:09.950 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T17:24:09.950 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_1 2026-02-24T17:24:09.994 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T17:24:09.995 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:09.995 INFO:teuthology.orchestra.run.trial040.stdout:Device: 5h/5d Inode: 905 Links: 1 2026-02-24T17:24:09.995 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:09.995 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-24 17:21:52.844134346 +0000 2026-02-24T17:24:09.995 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-24 17:21:52.672137276 +0000 2026-02-24T17:24:09.995 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-24 17:21:52.672137276 +0000 2026-02-24T17:24:09.995 INFO:teuthology.orchestra.run.trial040.stdout: Birth: - 2026-02-24T17:24:09.996 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T17:24:10.045 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-24T17:24:10.046 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-24T17:24:10.046 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000176006 s, 2.9 MB/s 2026-02-24T17:24:10.047 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T17:24:10.096 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_2 2026-02-24T17:24:10.142 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T17:24:10.142 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:10.142 INFO:teuthology.orchestra.run.trial040.stdout:Device: 5h/5d Inode: 928 Links: 1 2026-02-24T17:24:10.143 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:10.143 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-24 17:21:53.180128623 +0000 2026-02-24T17:24:10.143 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-24 17:21:53.000131691 +0000 2026-02-24T17:24:10.143 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-24 17:21:53.000131691 +0000 2026-02-24T17:24:10.143 INFO:teuthology.orchestra.run.trial040.stdout: Birth: - 2026-02-24T17:24:10.143 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T17:24:10.193 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-24T17:24:10.193 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-24T17:24:10.193 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000185423 s, 2.8 MB/s 2026-02-24T17:24:10.193 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T17:24:10.239 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_3 2026-02-24T17:24:10.286 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T17:24:10.286 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:10.286 INFO:teuthology.orchestra.run.trial040.stdout:Device: 5h/5d Inode: 954 Links: 1 2026-02-24T17:24:10.287 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:10.287 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-24 17:21:53.484123442 +0000 2026-02-24T17:24:10.287 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-24 17:21:53.328126102 +0000 2026-02-24T17:24:10.287 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-24 17:21:53.328126102 +0000 2026-02-24T17:24:10.287 INFO:teuthology.orchestra.run.trial040.stdout: Birth: - 2026-02-24T17:24:10.287 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T17:24:10.337 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-24T17:24:10.337 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-24T17:24:10.337 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000171388 s, 3.0 MB/s 2026-02-24T17:24:10.338 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T17:24:10.383 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_4 2026-02-24T17:24:10.430 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T17:24:10.430 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:10.430 INFO:teuthology.orchestra.run.trial040.stdout:Device: 5h/5d Inode: 978 Links: 1 2026-02-24T17:24:10.430 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:10.430 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-24 17:21:53.832117513 +0000 2026-02-24T17:24:10.430 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-24 17:21:53.656120513 +0000 2026-02-24T17:24:10.431 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-24 17:21:53.656120513 +0000 2026-02-24T17:24:10.431 INFO:teuthology.orchestra.run.trial040.stdout: Birth: - 2026-02-24T17:24:10.431 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T17:24:10.476 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-24T17:24:10.477 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-24T17:24:10.477 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000171718 s, 3.0 MB/s 2026-02-24T17:24:10.477 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T17:24:10.523 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:10.523 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:10.523 DEBUG:teuthology.orchestra.run.trial094:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T17:24:10.527 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T17:24:10.528 DEBUG:teuthology.orchestra.run.trial094:> stat /dev/vg_nvme/lv_1 2026-02-24T17:24:10.574 INFO:teuthology.orchestra.run.trial094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T17:24:10.574 INFO:teuthology.orchestra.run.trial094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:10.574 INFO:teuthology.orchestra.run.trial094.stdout:Device: 5h/5d Inode: 906 Links: 1 2026-02-24T17:24:10.574 INFO:teuthology.orchestra.run.trial094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:10.574 INFO:teuthology.orchestra.run.trial094.stdout:Access: 2026-02-24 17:21:53.615694977 +0000 2026-02-24T17:24:10.574 INFO:teuthology.orchestra.run.trial094.stdout:Modify: 2026-02-24 17:21:53.439697969 +0000 2026-02-24T17:24:10.574 INFO:teuthology.orchestra.run.trial094.stdout:Change: 2026-02-24 17:21:53.439697969 +0000 2026-02-24T17:24:10.574 INFO:teuthology.orchestra.run.trial094.stdout: Birth: - 2026-02-24T17:24:10.574 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T17:24:10.622 INFO:teuthology.orchestra.run.trial094.stderr:1+0 records in 2026-02-24T17:24:10.622 INFO:teuthology.orchestra.run.trial094.stderr:1+0 records out 2026-02-24T17:24:10.622 INFO:teuthology.orchestra.run.trial094.stderr:512 bytes copied, 0.000178852 s, 2.9 MB/s 2026-02-24T17:24:10.623 DEBUG:teuthology.orchestra.run.trial094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T17:24:10.671 DEBUG:teuthology.orchestra.run.trial094:> stat /dev/vg_nvme/lv_2 2026-02-24T17:24:10.718 INFO:teuthology.orchestra.run.trial094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T17:24:10.718 INFO:teuthology.orchestra.run.trial094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:10.718 INFO:teuthology.orchestra.run.trial094.stdout:Device: 5h/5d Inode: 930 Links: 1 2026-02-24T17:24:10.718 INFO:teuthology.orchestra.run.trial094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:10.718 INFO:teuthology.orchestra.run.trial094.stdout:Access: 2026-02-24 17:21:53.939689469 +0000 2026-02-24T17:24:10.718 INFO:teuthology.orchestra.run.trial094.stdout:Modify: 2026-02-24 17:21:53.771692326 +0000 2026-02-24T17:24:10.718 INFO:teuthology.orchestra.run.trial094.stdout:Change: 2026-02-24 17:21:53.771692326 +0000 2026-02-24T17:24:10.718 INFO:teuthology.orchestra.run.trial094.stdout: Birth: - 2026-02-24T17:24:10.718 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T17:24:10.766 INFO:teuthology.orchestra.run.trial094.stderr:1+0 records in 2026-02-24T17:24:10.766 INFO:teuthology.orchestra.run.trial094.stderr:1+0 records out 2026-02-24T17:24:10.766 INFO:teuthology.orchestra.run.trial094.stderr:512 bytes copied, 0.000178351 s, 2.9 MB/s 2026-02-24T17:24:10.767 DEBUG:teuthology.orchestra.run.trial094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T17:24:10.815 DEBUG:teuthology.orchestra.run.trial094:> stat /dev/vg_nvme/lv_3 2026-02-24T17:24:10.862 INFO:teuthology.orchestra.run.trial094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T17:24:10.862 INFO:teuthology.orchestra.run.trial094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:10.862 INFO:teuthology.orchestra.run.trial094.stdout:Device: 5h/5d Inode: 965 Links: 1 2026-02-24T17:24:10.862 INFO:teuthology.orchestra.run.trial094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:10.862 INFO:teuthology.orchestra.run.trial094.stdout:Access: 2026-02-24 17:21:54.103686680 +0000 2026-02-24T17:24:10.862 INFO:teuthology.orchestra.run.trial094.stdout:Modify: 2026-02-24 17:21:54.099686749 +0000 2026-02-24T17:24:10.862 INFO:teuthology.orchestra.run.trial094.stdout:Change: 2026-02-24 17:21:54.099686749 +0000 2026-02-24T17:24:10.862 INFO:teuthology.orchestra.run.trial094.stdout: Birth: - 2026-02-24T17:24:10.862 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T17:24:10.909 INFO:teuthology.orchestra.run.trial094.stderr:1+0 records in 2026-02-24T17:24:10.909 INFO:teuthology.orchestra.run.trial094.stderr:1+0 records out 2026-02-24T17:24:10.909 INFO:teuthology.orchestra.run.trial094.stderr:512 bytes copied, 0.000177149 s, 2.9 MB/s 2026-02-24T17:24:10.910 DEBUG:teuthology.orchestra.run.trial094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T17:24:10.956 DEBUG:teuthology.orchestra.run.trial094:> stat /dev/vg_nvme/lv_4 2026-02-24T17:24:11.002 INFO:teuthology.orchestra.run.trial094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T17:24:11.003 INFO:teuthology.orchestra.run.trial094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:11.003 INFO:teuthology.orchestra.run.trial094.stdout:Device: 5h/5d Inode: 977 Links: 1 2026-02-24T17:24:11.003 INFO:teuthology.orchestra.run.trial094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:11.003 INFO:teuthology.orchestra.run.trial094.stdout:Access: 2026-02-24 17:21:54.603678181 +0000 2026-02-24T17:24:11.003 INFO:teuthology.orchestra.run.trial094.stdout:Modify: 2026-02-24 17:21:54.443680900 +0000 2026-02-24T17:24:11.003 INFO:teuthology.orchestra.run.trial094.stdout:Change: 2026-02-24 17:21:54.443680900 +0000 2026-02-24T17:24:11.003 INFO:teuthology.orchestra.run.trial094.stdout: Birth: - 2026-02-24T17:24:11.003 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T17:24:11.050 INFO:teuthology.orchestra.run.trial094.stderr:1+0 records in 2026-02-24T17:24:11.050 INFO:teuthology.orchestra.run.trial094.stderr:1+0 records out 2026-02-24T17:24:11.050 INFO:teuthology.orchestra.run.trial094.stderr:512 bytes copied, 0.000175376 s, 2.9 MB/s 2026-02-24T17:24:11.051 DEBUG:teuthology.orchestra.run.trial094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T17:24:11.099 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:11.099 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:11.099 DEBUG:teuthology.orchestra.run.trial109:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T17:24:11.103 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T17:24:11.103 DEBUG:teuthology.orchestra.run.trial109:> stat /dev/vg_nvme/lv_1 2026-02-24T17:24:11.150 INFO:teuthology.orchestra.run.trial109.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T17:24:11.150 INFO:teuthology.orchestra.run.trial109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:11.150 INFO:teuthology.orchestra.run.trial109.stdout:Device: 5h/5d Inode: 904 Links: 1 2026-02-24T17:24:11.151 INFO:teuthology.orchestra.run.trial109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:11.151 INFO:teuthology.orchestra.run.trial109.stdout:Access: 2026-02-24 17:21:54.795488625 +0000 2026-02-24T17:24:11.151 INFO:teuthology.orchestra.run.trial109.stdout:Modify: 2026-02-24 17:21:54.615491693 +0000 2026-02-24T17:24:11.151 INFO:teuthology.orchestra.run.trial109.stdout:Change: 2026-02-24 17:21:54.615491693 +0000 2026-02-24T17:24:11.151 INFO:teuthology.orchestra.run.trial109.stdout: Birth: - 2026-02-24T17:24:11.151 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T17:24:11.198 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records in 2026-02-24T17:24:11.198 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records out 2026-02-24T17:24:11.199 INFO:teuthology.orchestra.run.trial109.stderr:512 bytes copied, 0.00019395 s, 2.6 MB/s 2026-02-24T17:24:11.200 DEBUG:teuthology.orchestra.run.trial109:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T17:24:11.248 DEBUG:teuthology.orchestra.run.trial109:> stat /dev/vg_nvme/lv_2 2026-02-24T17:24:11.294 INFO:teuthology.orchestra.run.trial109.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T17:24:11.295 INFO:teuthology.orchestra.run.trial109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:11.295 INFO:teuthology.orchestra.run.trial109.stdout:Device: 5h/5d Inode: 940 Links: 1 2026-02-24T17:24:11.295 INFO:teuthology.orchestra.run.trial109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:11.295 INFO:teuthology.orchestra.run.trial109.stdout:Access: 2026-02-24 17:21:54.951485970 +0000 2026-02-24T17:24:11.295 INFO:teuthology.orchestra.run.trial109.stdout:Modify: 2026-02-24 17:21:54.947486035 +0000 2026-02-24T17:24:11.295 INFO:teuthology.orchestra.run.trial109.stdout:Change: 2026-02-24 17:21:54.947486035 +0000 2026-02-24T17:24:11.295 INFO:teuthology.orchestra.run.trial109.stdout: Birth: - 2026-02-24T17:24:11.296 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T17:24:11.346 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records in 2026-02-24T17:24:11.346 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records out 2026-02-24T17:24:11.346 INFO:teuthology.orchestra.run.trial109.stderr:512 bytes copied, 0.0001827 s, 2.8 MB/s 2026-02-24T17:24:11.347 DEBUG:teuthology.orchestra.run.trial109:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T17:24:11.395 DEBUG:teuthology.orchestra.run.trial109:> stat /dev/vg_nvme/lv_3 2026-02-24T17:24:11.443 INFO:teuthology.orchestra.run.trial109.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T17:24:11.443 INFO:teuthology.orchestra.run.trial109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:11.443 INFO:teuthology.orchestra.run.trial109.stdout:Device: 5h/5d Inode: 955 Links: 1 2026-02-24T17:24:11.443 INFO:teuthology.orchestra.run.trial109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:11.443 INFO:teuthology.orchestra.run.trial109.stdout:Access: 2026-02-24 17:21:55.431477793 +0000 2026-02-24T17:24:11.443 INFO:teuthology.orchestra.run.trial109.stdout:Modify: 2026-02-24 17:21:55.287480247 +0000 2026-02-24T17:24:11.443 INFO:teuthology.orchestra.run.trial109.stdout:Change: 2026-02-24 17:21:55.287480247 +0000 2026-02-24T17:24:11.443 INFO:teuthology.orchestra.run.trial109.stdout: Birth: - 2026-02-24T17:24:11.444 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T17:24:11.493 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records in 2026-02-24T17:24:11.493 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records out 2026-02-24T17:24:11.494 INFO:teuthology.orchestra.run.trial109.stderr:512 bytes copied, 0.000187719 s, 2.7 MB/s 2026-02-24T17:24:11.495 DEBUG:teuthology.orchestra.run.trial109:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T17:24:11.543 DEBUG:teuthology.orchestra.run.trial109:> stat /dev/vg_nvme/lv_4 2026-02-24T17:24:11.590 INFO:teuthology.orchestra.run.trial109.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T17:24:11.591 INFO:teuthology.orchestra.run.trial109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:11.591 INFO:teuthology.orchestra.run.trial109.stdout:Device: 5h/5d Inode: 976 Links: 1 2026-02-24T17:24:11.591 INFO:teuthology.orchestra.run.trial109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:11.591 INFO:teuthology.orchestra.run.trial109.stdout:Access: 2026-02-24 17:21:55.587475137 +0000 2026-02-24T17:24:11.591 INFO:teuthology.orchestra.run.trial109.stdout:Modify: 2026-02-24 17:21:55.583475202 +0000 2026-02-24T17:24:11.591 INFO:teuthology.orchestra.run.trial109.stdout:Change: 2026-02-24 17:21:55.583475202 +0000 2026-02-24T17:24:11.591 INFO:teuthology.orchestra.run.trial109.stdout: Birth: - 2026-02-24T17:24:11.592 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T17:24:11.645 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records in 2026-02-24T17:24:11.646 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records out 2026-02-24T17:24:11.646 INFO:teuthology.orchestra.run.trial109.stderr:512 bytes copied, 0.000166349 s, 3.1 MB/s 2026-02-24T17:24:11.647 DEBUG:teuthology.orchestra.run.trial109:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T17:24:11.696 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:11.696 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:11.696 DEBUG:teuthology.orchestra.run.trial120:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T17:24:11.702 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T17:24:11.702 DEBUG:teuthology.orchestra.run.trial120:> stat /dev/vg_nvme/lv_1 2026-02-24T17:24:11.747 INFO:teuthology.orchestra.run.trial120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T17:24:11.747 INFO:teuthology.orchestra.run.trial120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:11.747 INFO:teuthology.orchestra.run.trial120.stdout:Device: 5h/5d Inode: 907 Links: 1 2026-02-24T17:24:11.747 INFO:teuthology.orchestra.run.trial120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:11.747 INFO:teuthology.orchestra.run.trial120.stdout:Access: 2026-02-24 17:21:54.339336274 +0000 2026-02-24T17:24:11.747 INFO:teuthology.orchestra.run.trial120.stdout:Modify: 2026-02-24 17:21:54.159339332 +0000 2026-02-24T17:24:11.747 INFO:teuthology.orchestra.run.trial120.stdout:Change: 2026-02-24 17:21:54.159339332 +0000 2026-02-24T17:24:11.747 INFO:teuthology.orchestra.run.trial120.stdout: Birth: - 2026-02-24T17:24:11.747 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T17:24:11.795 INFO:teuthology.orchestra.run.trial120.stderr:1+0 records in 2026-02-24T17:24:11.795 INFO:teuthology.orchestra.run.trial120.stderr:1+0 records out 2026-02-24T17:24:11.795 INFO:teuthology.orchestra.run.trial120.stderr:512 bytes copied, 0.000190274 s, 2.7 MB/s 2026-02-24T17:24:11.796 DEBUG:teuthology.orchestra.run.trial120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T17:24:11.845 DEBUG:teuthology.orchestra.run.trial120:> stat /dev/vg_nvme/lv_2 2026-02-24T17:24:11.891 INFO:teuthology.orchestra.run.trial120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T17:24:11.891 INFO:teuthology.orchestra.run.trial120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:11.891 INFO:teuthology.orchestra.run.trial120.stdout:Device: 5h/5d Inode: 930 Links: 1 2026-02-24T17:24:11.891 INFO:teuthology.orchestra.run.trial120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:11.891 INFO:teuthology.orchestra.run.trial120.stdout:Access: 2026-02-24 17:21:54.499333554 +0000 2026-02-24T17:24:11.891 INFO:teuthology.orchestra.run.trial120.stdout:Modify: 2026-02-24 17:21:54.495333620 +0000 2026-02-24T17:24:11.891 INFO:teuthology.orchestra.run.trial120.stdout:Change: 2026-02-24 17:21:54.495333620 +0000 2026-02-24T17:24:11.891 INFO:teuthology.orchestra.run.trial120.stdout: Birth: - 2026-02-24T17:24:11.891 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T17:24:11.938 INFO:teuthology.orchestra.run.trial120.stderr:1+0 records in 2026-02-24T17:24:11.939 INFO:teuthology.orchestra.run.trial120.stderr:1+0 records out 2026-02-24T17:24:11.939 INFO:teuthology.orchestra.run.trial120.stderr:512 bytes copied, 0.000175506 s, 2.9 MB/s 2026-02-24T17:24:11.940 DEBUG:teuthology.orchestra.run.trial120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T17:24:11.989 DEBUG:teuthology.orchestra.run.trial120:> stat /dev/vg_nvme/lv_3 2026-02-24T17:24:12.036 INFO:teuthology.orchestra.run.trial120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T17:24:12.036 INFO:teuthology.orchestra.run.trial120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:12.036 INFO:teuthology.orchestra.run.trial120.stdout:Device: 5h/5d Inode: 954 Links: 1 2026-02-24T17:24:12.036 INFO:teuthology.orchestra.run.trial120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:12.036 INFO:teuthology.orchestra.run.trial120.stdout:Access: 2026-02-24 17:21:55.023324643 +0000 2026-02-24T17:24:12.037 INFO:teuthology.orchestra.run.trial120.stdout:Modify: 2026-02-24 17:21:54.859327431 +0000 2026-02-24T17:24:12.037 INFO:teuthology.orchestra.run.trial120.stdout:Change: 2026-02-24 17:21:54.859327431 +0000 2026-02-24T17:24:12.037 INFO:teuthology.orchestra.run.trial120.stdout: Birth: - 2026-02-24T17:24:12.037 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T17:24:12.087 INFO:teuthology.orchestra.run.trial120.stderr:1+0 records in 2026-02-24T17:24:12.087 INFO:teuthology.orchestra.run.trial120.stderr:1+0 records out 2026-02-24T17:24:12.087 INFO:teuthology.orchestra.run.trial120.stderr:512 bytes copied, 0.000175957 s, 2.9 MB/s 2026-02-24T17:24:12.088 DEBUG:teuthology.orchestra.run.trial120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T17:24:12.136 DEBUG:teuthology.orchestra.run.trial120:> stat /dev/vg_nvme/lv_4 2026-02-24T17:24:12.184 INFO:teuthology.orchestra.run.trial120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T17:24:12.184 INFO:teuthology.orchestra.run.trial120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T17:24:12.184 INFO:teuthology.orchestra.run.trial120.stdout:Device: 5h/5d Inode: 979 Links: 1 2026-02-24T17:24:12.185 INFO:teuthology.orchestra.run.trial120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T17:24:12.185 INFO:teuthology.orchestra.run.trial120.stdout:Access: 2026-02-24 17:21:55.371318727 +0000 2026-02-24T17:24:12.185 INFO:teuthology.orchestra.run.trial120.stdout:Modify: 2026-02-24 17:21:55.179321993 +0000 2026-02-24T17:24:12.185 INFO:teuthology.orchestra.run.trial120.stdout:Change: 2026-02-24 17:21:55.179321993 +0000 2026-02-24T17:24:12.185 INFO:teuthology.orchestra.run.trial120.stdout: Birth: - 2026-02-24T17:24:12.186 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T17:24:12.234 INFO:teuthology.orchestra.run.trial120.stderr:1+0 records in 2026-02-24T17:24:12.234 INFO:teuthology.orchestra.run.trial120.stderr:1+0 records out 2026-02-24T17:24:12.234 INFO:teuthology.orchestra.run.trial120.stderr:512 bytes copied, 0.000163293 s, 3.1 MB/s 2026-02-24T17:24:12.236 DEBUG:teuthology.orchestra.run.trial120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T17:24:12.284 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:12.284 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial094.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial109.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial120.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-24T17:24:12.284 INFO:tasks.ceph:Generating config... 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] bluestore debug onode segmentation random = True 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-24T17:24:12.285 INFO:tasks.ceph:[osd] bluestore onode segment size = 512K 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd backoff on peering = True 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd inject bad map crc probability = 0.1 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd max scrubs = 1 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-24T17:24:12.286 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-24T17:24:12.287 INFO:tasks.ceph:[client] debug ms = 1 2026-02-24T17:24:12.287 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-24T17:24:12.287 INFO:tasks.ceph:[client] debug rados = 20 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] ms bind msgr1 = False 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] ms bind msgr2 = True 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] ms tcp read timeout = 5 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] ms type = async 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2026-02-24T17:24:12.287 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2026-02-24T17:24:12.287 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-24T17:24:12.287 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-24T17:24:12.287 INFO:tasks.ceph:[mon] debug mgrc = 20 2026-02-24T17:24:12.287 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-24T17:24:12.287 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-24T17:24:12.287 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-24T17:24:12.287 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-24T17:24:12.287 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-24T17:24:12.287 INFO:tasks.ceph:Setting up mon.a... 2026-02-24T17:24:12.287 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-24T17:24:12.305 INFO:teuthology.orchestra.run.trial040.stdout:creating /etc/ceph/ceph.keyring 2026-02-24T17:24:12.308 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-24T17:24:12.373 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T17:24:12.426 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.40'), ('mon.b', '10.20.193.94'), ('mon.c', '10.20.193.109')] 2026-02-24T17:24:12.427 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.40,10.20.193.94,10.20.193.109', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore debug onode segmentation random': True, 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd max scrubs': 1, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'debug mgrc': 20, 'mon scrub interval': 300, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-24T17:24:12.427 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:12.427 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T17:24:12.474 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.40 --add b 10.20.193.94 --add c 10.20.193.109 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:12.533 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:12.533 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: generated fsid f24f61d3-eddb-4c62-878a-4823ddf02ae6 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:setting min_mon_release = tentacle 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:epoch 0 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:fsid f24f61d3-eddb-4c62-878a-4823ddf02ae6 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:last_changed 2026-02-24T17:24:12.528263+0000 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:created 2026-02-24T17:24:12.528263+0000 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:min_mon_release 20 (tentacle) 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:election_strategy: 1 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-24T17:24:12.534 INFO:teuthology.orchestra.run.trial040.stdout:1: [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] mon.b 2026-02-24T17:24:12.535 INFO:teuthology.orchestra.run.trial040.stdout:2: [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] mon.c 2026-02-24T17:24:12.535 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-24T17:24:12.536 DEBUG:teuthology.orchestra.run.trial040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T17:24:12.581 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f24f61d3-eddb-4c62-878a-4823ddf02ae6... 2026-02-24T17:24:12.582 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T17:24:12.623 DEBUG:teuthology.orchestra.run.trial094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T17:24:12.625 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T17:24:12.626 DEBUG:teuthology.orchestra.run.trial120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout:[global] 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: chdir = "" 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: auth supported = cephx 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: filestore xattr use omap = true 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: mon clock drift allowed = 1.000 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: osd crush chooseleaf type = 0 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: auth debug = true 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: ms die on old message = true 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: ms die on bug = true 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: mon pg warn max object skew = 0 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: osd pool default size = 2 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: mon osd allow primary affinity = true 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: mon osd allow pg remap = true 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on legacy crush tunables = false 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on crush straw calc version zero = false 2026-02-24T17:24:12.639 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on no sortbitwise = false 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on osd down out interval zero = false 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on too few osds = false 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon_allow_pool_size_one = true 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: osd default data pool replay window = 5 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon allow pool delete = true 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon cluster log file level = debug 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: debug asserts on shutdown = true 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon health detail to clog = false 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon host = "10.20.193.40,10.20.193.94,10.20.193.109" 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon client directed command retry = 5 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: mon election default strategy = 1 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: ms bind msgr1 = False 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: ms bind msgr2 = True 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: ms inject socket failures = 2500 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: ms tcp read timeout = 5 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: ms type = async 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: osd_pool_default_min_size = 2 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: osd_pool_default_size = 2 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: fsid = f24f61d3-eddb-4c62-878a-4823ddf02ae6 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout:[osd] 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: osd journal size = 100 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.640 INFO:teuthology.orchestra.run.trial040.stdout: osd scrub load threshold = 5.0 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd scrub max interval = 600 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd mclock profile = high_recovery_ops 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd mclock skip benchmark = True 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd recover clone overlap = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd recovery max chunk = 1048576 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd debug shutdown = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd debug op order = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd debug verify stray on activate = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd debug trim objects = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd open classes on start = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd debug pg log writeout = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd deep scrub update digest min age = 30 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd map max advance = 10 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: journal zero on create = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: filestore ondisk finisher threads = 3 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: filestore apply finisher threads = 3 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: bdev debug aio = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: osd debug misdirected ops = true 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: debug monc = 20 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: bdev async discard = True 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: bdev enable discard = True 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: bluefs allocator = hybrid 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: bluestore allocator = hybrid 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: bluestore block size = 96636764160 2026-02-24T17:24:12.641 INFO:teuthology.orchestra.run.trial040.stdout: bluestore debug onode segmentation random = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: bluestore fsck on mount = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: bluestore onode segment size = 512K 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: bluestore write v2 random = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: bluestore zero block detection = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: debug bluefs = 20 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: debug bluestore = 20 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 1 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: debug osd = 20 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: debug rocksdb = 10 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: mon osd full ratio = 0.9 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: mon osd nearfull ratio = 0.8 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd backoff on peering = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd blocked scrub grace period = 3600 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd class default list = * 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd class load list = * 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd client watch timeout = 240 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd debug verify cached snaps = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd debug verify missing on start = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd failsafe full ratio = 0.95 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd inject bad map crc probability = 0.1 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd max markdown count = 1000 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd max scrubs = 1 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd mclock override recovery settings = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd memory target = 1610612736 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd objectstore = bluestore 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd op queue = debug_random 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd op queue cut off = debug_random 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: osd shutdown pgref assert = True 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout:[mgr] 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 1 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: debug mgr = 20 2026-02-24T17:24:12.642 INFO:teuthology.orchestra.run.trial040.stdout: debug mon = 20 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: debug auth = 20 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min pgs per osd = 4 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min bytes per osd = 10 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mgr/telemetry/nag = false 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout:[mon] 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 1 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: debug mon = 30 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: debug paxos = 20 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: debug auth = 20 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon data avail warn = 5 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon mgr mkfs grace = 240 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min pgs per osd = 4 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon osd reporter subtree level = osd 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon osd prime pg temp = true 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min bytes per osd = 10 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: # 1m isn't quite enough 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon_down_mkfs_grace = 2m 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_filestore_osds = false 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: debug mgrc = 20 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon scrub interval = 300 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on pool no app = False 2026-02-24T17:24:12.643 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout:[client] 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout: rgw cache enabled = true 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout: rgw enable ops log = true 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout: rgw enable usage log = true 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 1 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout: debug objecter = 20 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout: debug rados = 20 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout:[mon.a] 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout:[mon.b] 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial040.stdout:[mon.c] 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout:[global] 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: chdir = "" 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: auth supported = cephx 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: filestore xattr use omap = true 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: mon clock drift allowed = 1.000 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: osd crush chooseleaf type = 0 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: auth debug = true 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.644 INFO:teuthology.orchestra.run.trial094.stdout: ms die on old message = true 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: ms die on bug = true 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon pg warn max object skew = 0 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: osd pool default size = 2 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon osd allow primary affinity = true 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon osd allow pg remap = true 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon warn on legacy crush tunables = false 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon warn on crush straw calc version zero = false 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon warn on no sortbitwise = false 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon warn on osd down out interval zero = false 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon warn on too few osds = false 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon_allow_pool_size_one = true 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: osd default data pool replay window = 5 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon allow pool delete = true 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon cluster log file level = debug 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: debug asserts on shutdown = true 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon health detail to clog = false 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon host = "10.20.193.40,10.20.193.94,10.20.193.109" 2026-02-24T17:24:12.645 INFO:teuthology.orchestra.run.trial094.stdout: mon client directed command retry = 5 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: mon election default strategy = 1 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: ms bind msgr1 = False 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: ms bind msgr2 = True 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: ms inject socket failures = 2500 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: ms tcp read timeout = 5 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: ms type = async 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd_pool_default_min_size = 2 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd_pool_default_size = 2 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: fsid = f24f61d3-eddb-4c62-878a-4823ddf02ae6 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout:[osd] 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd journal size = 100 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd scrub load threshold = 5.0 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd scrub max interval = 600 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd mclock profile = high_recovery_ops 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd mclock skip benchmark = True 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd recover clone overlap = true 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd recovery max chunk = 1048576 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd debug shutdown = true 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd debug op order = true 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd debug verify stray on activate = true 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd debug trim objects = true 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd open classes on start = true 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd debug pg log writeout = true 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd deep scrub update digest min age = 30 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: osd map max advance = 10 2026-02-24T17:24:12.646 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: journal zero on create = true 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: filestore ondisk finisher threads = 3 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: filestore apply finisher threads = 3 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bdev debug aio = true 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: osd debug misdirected ops = true 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: debug monc = 20 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bdev async discard = True 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bdev enable discard = True 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bluefs allocator = hybrid 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bluestore allocator = hybrid 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bluestore block size = 96636764160 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bluestore debug onode segmentation random = True 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bluestore fsck on mount = True 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bluestore onode segment size = 512K 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bluestore write v2 random = True 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: bluestore zero block detection = True 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: debug bluefs = 20 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: debug bluestore = 20 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: debug ms = 1 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: debug osd = 20 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: debug rocksdb = 10 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: mon osd full ratio = 0.9 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: mon osd nearfull ratio = 0.8 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: osd backoff on peering = True 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: osd blocked scrub grace period = 3600 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: osd class default list = * 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: osd class load list = * 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: osd client watch timeout = 240 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: osd debug verify cached snaps = True 2026-02-24T17:24:12.647 INFO:teuthology.orchestra.run.trial094.stdout: osd debug verify missing on start = True 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd failsafe full ratio = 0.95 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd inject bad map crc probability = 0.1 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd max markdown count = 1000 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd max scrubs = 1 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd mclock override recovery settings = True 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd memory target = 1610612736 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd objectstore = bluestore 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd op queue = debug_random 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd op queue cut off = debug_random 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: osd shutdown pgref assert = True 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout:[mgr] 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: debug ms = 1 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: debug mgr = 20 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: debug mon = 20 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: debug auth = 20 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: mon reweight min pgs per osd = 4 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: mon reweight min bytes per osd = 10 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: mgr/telemetry/nag = false 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout:[mon] 2026-02-24T17:24:12.648 INFO:teuthology.orchestra.run.trial094.stdout: debug ms = 1 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: debug mon = 30 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: debug paxos = 20 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: debug auth = 20 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: mon data avail warn = 5 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: mon mgr mkfs grace = 240 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: mon reweight min pgs per osd = 4 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: mon osd reporter subtree level = osd 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: mon osd prime pg temp = true 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: mon reweight min bytes per osd = 10 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T17:24:12.649 INFO:teuthology.orchestra.run.trial094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: # 1m isn't quite enough 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: mon_down_mkfs_grace = 2m 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: mon_warn_on_filestore_osds = false 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: debug mgrc = 20 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: mon scrub interval = 300 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: mon warn on pool no app = False 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout:[client] 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: rgw cache enabled = true 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: rgw enable ops log = true 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: rgw enable usage log = true 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: debug ms = 1 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: debug objecter = 20 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout: debug rados = 20 2026-02-24T17:24:12.650 INFO:teuthology.orchestra.run.trial094.stdout:[mon.a] 2026-02-24T17:24:12.651 INFO:teuthology.orchestra.run.trial094.stdout:[mon.b] 2026-02-24T17:24:12.651 INFO:teuthology.orchestra.run.trial094.stdout:[mon.c] 2026-02-24T17:24:12.651 INFO:teuthology.orchestra.run.trial120.stdout:[global] 2026-02-24T17:24:12.651 INFO:teuthology.orchestra.run.trial120.stdout: chdir = "" 2026-02-24T17:24:12.651 INFO:teuthology.orchestra.run.trial120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T17:24:12.651 INFO:teuthology.orchestra.run.trial120.stdout: auth supported = cephx 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: filestore xattr use omap = true 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: mon clock drift allowed = 1.000 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: osd crush chooseleaf type = 0 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: auth debug = true 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: ms die on old message = true 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: ms die on bug = true 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: mon pg warn max object skew = 0 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T17:24:12.652 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: osd pool default size = 2 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon osd allow primary affinity = true 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon osd allow pg remap = true 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon warn on legacy crush tunables = false 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon warn on crush straw calc version zero = false 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon warn on no sortbitwise = false 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon warn on osd down out interval zero = false 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon warn on too few osds = false 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon_allow_pool_size_one = true 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: osd default data pool replay window = 5 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: mon allow pool delete = true 2026-02-24T17:24:12.653 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: mon cluster log file level = debug 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: debug asserts on shutdown = true 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: mon health detail to clog = false 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: mon host = "10.20.193.40,10.20.193.94,10.20.193.109" 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: mon client directed command retry = 5 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: mon election default strategy = 1 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: ms bind msgr1 = False 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: ms bind msgr2 = True 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: ms inject socket failures = 2500 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: ms tcp read timeout = 5 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: ms type = async 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: osd_pool_default_min_size = 2 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: osd_pool_default_size = 2 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: fsid = f24f61d3-eddb-4c62-878a-4823ddf02ae6 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout:[osd] 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: osd journal size = 100 2026-02-24T17:24:12.654 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd scrub load threshold = 5.0 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd scrub max interval = 600 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd mclock profile = high_recovery_ops 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd mclock skip benchmark = True 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd recover clone overlap = true 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd recovery max chunk = 1048576 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd debug shutdown = true 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd debug op order = true 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd debug verify stray on activate = true 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd debug trim objects = true 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd open classes on start = true 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd debug pg log writeout = true 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: osd deep scrub update digest min age = 30 2026-02-24T17:24:12.655 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: osd map max advance = 10 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: journal zero on create = true 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: filestore ondisk finisher threads = 3 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: filestore apply finisher threads = 3 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bdev debug aio = true 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: osd debug misdirected ops = true 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: debug monc = 20 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bdev async discard = True 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bdev enable discard = True 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bluefs allocator = hybrid 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bluestore allocator = hybrid 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bluestore block size = 96636764160 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bluestore debug onode segmentation random = True 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bluestore fsck on mount = True 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bluestore onode segment size = 512K 2026-02-24T17:24:12.656 INFO:teuthology.orchestra.run.trial120.stdout: bluestore write v2 random = True 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: bluestore zero block detection = True 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: debug bluefs = 20 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: debug bluestore = 20 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: debug ms = 1 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: debug osd = 20 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: debug rocksdb = 10 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: mon osd full ratio = 0.9 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: mon osd nearfull ratio = 0.8 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd backoff on peering = True 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd blocked scrub grace period = 3600 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd class default list = * 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd class load list = * 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd client watch timeout = 240 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd debug verify cached snaps = True 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd debug verify missing on start = True 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd failsafe full ratio = 0.95 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd inject bad map crc probability = 0.1 2026-02-24T17:24:12.657 INFO:teuthology.orchestra.run.trial120.stdout: osd max markdown count = 1000 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: osd max scrubs = 1 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: osd mclock override recovery settings = True 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: osd memory target = 1610612736 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: osd objectstore = bluestore 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: osd op queue = debug_random 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: osd op queue cut off = debug_random 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: osd shutdown pgref assert = True 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout:[mgr] 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: debug ms = 1 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: debug mgr = 20 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: debug mon = 20 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: debug auth = 20 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: mon reweight min pgs per osd = 4 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: mon reweight min bytes per osd = 10 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: mgr/telemetry/nag = false 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.658 INFO:teuthology.orchestra.run.trial120.stdout:[mon] 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: debug ms = 1 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: debug mon = 30 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: debug paxos = 20 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: debug auth = 20 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: mon data avail warn = 5 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: mon mgr mkfs grace = 240 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: mon reweight min pgs per osd = 4 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: mon osd reporter subtree level = osd 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: mon osd prime pg temp = true 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: mon reweight min bytes per osd = 10 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T17:24:12.659 INFO:teuthology.orchestra.run.trial120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: # 1m isn't quite enough 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: mon_down_mkfs_grace = 2m 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: mon_warn_on_filestore_osds = false 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: debug mgrc = 20 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: mon scrub interval = 300 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: mon warn on pool no app = False 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout:[client] 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: rgw cache enabled = true 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: rgw enable ops log = true 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: rgw enable usage log = true 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: debug ms = 1 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: debug objecter = 20 2026-02-24T17:24:12.660 INFO:teuthology.orchestra.run.trial120.stdout: debug rados = 20 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial120.stdout:[mon.a] 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial120.stdout:[mon.b] 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial120.stdout:[mon.c] 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial109.stdout:[global] 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial109.stdout: chdir = "" 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial109.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial109.stdout: auth supported = cephx 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial109.stdout: filestore xattr use omap = true 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.661 INFO:teuthology.orchestra.run.trial109.stdout: mon clock drift allowed = 1.000 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: osd crush chooseleaf type = 0 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: auth debug = true 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: ms die on old message = true 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: ms die on bug = true 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon pg warn max object skew = 0 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: osd pool default size = 2 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon osd allow primary affinity = true 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon osd allow pg remap = true 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on legacy crush tunables = false 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on crush straw calc version zero = false 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on no sortbitwise = false 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on osd down out interval zero = false 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on too few osds = false 2026-02-24T17:24:12.662 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: mon_allow_pool_size_one = true 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: osd default data pool replay window = 5 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: mon allow pool delete = true 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: mon cluster log file level = debug 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: debug asserts on shutdown = true 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: mon health detail to clog = false 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: mon host = "10.20.193.40,10.20.193.94,10.20.193.109" 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: mon client directed command retry = 5 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: mon election default strategy = 1 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: ms bind msgr1 = False 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: ms bind msgr2 = True 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: ms inject socket failures = 2500 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: ms tcp read timeout = 5 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: ms type = async 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: osd_pool_default_min_size = 2 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: osd_pool_default_size = 2 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: fsid = f24f61d3-eddb-4c62-878a-4823ddf02ae6 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.663 INFO:teuthology.orchestra.run.trial109.stdout:[osd] 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd journal size = 100 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd scrub load threshold = 5.0 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd scrub max interval = 600 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd mclock profile = high_recovery_ops 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd mclock skip benchmark = True 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd recover clone overlap = true 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd recovery max chunk = 1048576 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd debug shutdown = true 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd debug op order = true 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd debug verify stray on activate = true 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd debug trim objects = true 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd open classes on start = true 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd debug pg log writeout = true 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd deep scrub update digest min age = 30 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: osd map max advance = 10 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.664 INFO:teuthology.orchestra.run.trial109.stdout: journal zero on create = true 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: filestore ondisk finisher threads = 3 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: filestore apply finisher threads = 3 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bdev debug aio = true 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: osd debug misdirected ops = true 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: debug monc = 20 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bdev async discard = True 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bdev enable discard = True 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bluefs allocator = hybrid 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bluestore allocator = hybrid 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bluestore block size = 96636764160 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bluestore debug onode segmentation random = True 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bluestore fsck on mount = True 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bluestore onode segment size = 512K 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bluestore write v2 random = True 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: bluestore zero block detection = True 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: debug bluefs = 20 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: debug bluestore = 20 2026-02-24T17:24:12.665 INFO:teuthology.orchestra.run.trial109.stdout: debug ms = 1 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: debug osd = 20 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: debug rocksdb = 10 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: mon osd full ratio = 0.9 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: mon osd nearfull ratio = 0.8 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd backoff on peering = True 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd blocked scrub grace period = 3600 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd class default list = * 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd class load list = * 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd client watch timeout = 240 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd debug verify cached snaps = True 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd debug verify missing on start = True 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd failsafe full ratio = 0.95 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd inject bad map crc probability = 0.1 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd max markdown count = 1000 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd max scrubs = 1 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd mclock override recovery settings = True 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd memory target = 1610612736 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd objectstore = bluestore 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd op queue = debug_random 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd op queue cut off = debug_random 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: osd shutdown pgref assert = True 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout:[mgr] 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: debug ms = 1 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: debug mgr = 20 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: debug mon = 20 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: debug auth = 20 2026-02-24T17:24:12.666 INFO:teuthology.orchestra.run.trial109.stdout: mon reweight min pgs per osd = 4 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon reweight min bytes per osd = 10 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mgr/telemetry/nag = false 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout:[mon] 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: debug ms = 1 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: debug mon = 30 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: debug paxos = 20 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: debug auth = 20 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon data avail warn = 5 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon mgr mkfs grace = 240 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon reweight min pgs per osd = 4 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon osd reporter subtree level = osd 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon osd prime pg temp = true 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon reweight min bytes per osd = 10 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: # 1m isn't quite enough 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon_down_mkfs_grace = 2m 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_filestore_osds = false 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: debug mgrc = 20 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon scrub interval = 300 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on pool no app = False 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout:[client] 2026-02-24T17:24:12.667 INFO:teuthology.orchestra.run.trial109.stdout: rgw cache enabled = true 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout: rgw enable ops log = true 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout: rgw enable usage log = true 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout: debug ms = 1 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout: debug objecter = 20 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout: debug rados = 20 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout:[mon.a] 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout:[mon.b] 2026-02-24T17:24:12.668 INFO:teuthology.orchestra.run.trial109.stdout:[mon.c] 2026-02-24T17:24:12.669 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-24T17:24:12.669 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-24T17:24:12.732 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-24T17:24:12.733 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:12.733 DEBUG:teuthology.orchestra.run.trial040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-24T17:24:12.782 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:12.782 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-24T17:24:12.826 INFO:tasks.ceph:Sending monmap to node ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:24:12.826 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:12.826 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T17:24:12.826 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T17:24:12.880 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:12.880 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:12.926 INFO:tasks.ceph:Sending monmap to node ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:24:12.926 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:12.926 DEBUG:teuthology.orchestra.run.trial094:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T17:24:12.926 DEBUG:teuthology.orchestra.run.trial094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T17:24:12.940 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:12.940 DEBUG:teuthology.orchestra.run.trial094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:12.987 INFO:tasks.ceph:Sending monmap to node ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:24:12.987 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:12.987 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T17:24:12.987 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T17:24:13.001 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:13.001 DEBUG:teuthology.orchestra.run.trial109:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:13.046 INFO:tasks.ceph:Sending monmap to node ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:24:13.046 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:13.046 DEBUG:teuthology.orchestra.run.trial120:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T17:24:13.046 DEBUG:teuthology.orchestra.run.trial120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T17:24:13.061 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:13.061 DEBUG:teuthology.orchestra.run.trial120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:13.108 INFO:tasks.ceph:Setting up mon nodes... 2026-02-24T17:24:13.108 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-24T17:24:13.109 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-24T17:24:13.133 INFO:teuthology.orchestra.run.trial040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-24T17:24:13.135 DEBUG:teuthology.orchestra.run.trial120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T17:24:13.175 INFO:teuthology.orchestra.run.trial120.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T17:24:13.178 INFO:tasks.ceph:Setting up mds nodes... 2026-02-24T17:24:13.178 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-24T17:24:13.178 DEBUG:teuthology.orchestra.run.trial120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T17:24:13.236 INFO:teuthology.orchestra.run.trial120.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-24T17:24:13.243 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-24T17:24:13.244 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial094.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial109.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial120.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-24T17:24:13.244 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-24T17:24:13.252 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:13.252 INFO:tasks.ceph:role: osd.0 2026-02-24T17:24:13.252 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:24:13.252 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T17:24:13.303 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:13.303 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:13.303 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:13.303 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:13.303 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:13.303 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:13.303 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:13.303 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:13.304 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:13.304 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:13.885 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-24T17:24:13.886 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-24T17:24:13.886 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-24T17:24:13.942 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-24T17:24:13.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:13.988 INFO:teuthology.orchestra.run.trial040.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:13.989 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-24T17:24:14.038 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:14.038 INFO:tasks.ceph:role: osd.4 2026-02-24T17:24:14.039 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:24:14.039 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T17:24:14.092 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:14.092 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:14.092 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:14.092 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:14.092 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:14.092 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:14.092 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:14.093 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:14.093 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:14.093 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:14.657 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-24T17:24:14.658 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-24T17:24:14.658 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-24T17:24:14.715 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-24T17:24:14.763 INFO:teuthology.orchestra.run.trial040.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:14.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:14.764 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-24T17:24:14.814 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:14.814 INFO:tasks.ceph:role: osd.8 2026-02-24T17:24:14.814 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:24:14.814 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:14.864 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:15.438 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-24T17:24:15.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-24T17:24:15.440 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-24T17:24:15.494 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-24T17:24:15.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:15.541 INFO:teuthology.orchestra.run.trial040.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:15.541 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-24T17:24:15.590 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:15.590 INFO:tasks.ceph:role: osd.12 2026-02-24T17:24:15.590 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:24:15.590 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:15.639 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:15.640 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:16.206 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-24T17:24:16.207 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-24T17:24:16.207 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-24T17:24:16.263 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-24T17:24:16.312 INFO:teuthology.orchestra.run.trial040.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:16.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:16.312 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:16.375 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:16.368+0000 7f859ca5ba40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-24T17:24:16.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:16.368+0000 7f859ca5ba40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-24T17:24:16.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:16.368+0000 7f859ca5ba40 -1 bdev(0x55fe2f44b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:16.376 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:16.368+0000 7f859ca5ba40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-24T17:24:17.168 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-24T17:24:17.219 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:17.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:17.272+0000 7fe1b108ca40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-24T17:24:17.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:17.276+0000 7fe1b108ca40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-24T17:24:17.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:17.276+0000 7fe1b108ca40 -1 bdev(0x557a6b8d3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:17.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:17.276+0000 7fe1b108ca40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-24T17:24:18.114 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-24T17:24:18.167 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:18.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:18.224+0000 7f22773f1a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-24T17:24:18.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:18.224+0000 7f22773f1a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-24T17:24:18.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:18.224+0000 7f22773f1a40 -1 bdev(0x564aec7f5800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:18.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:18.224+0000 7f22773f1a40 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-24T17:24:19.080 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-24T17:24:19.131 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:19.194 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:19.188+0000 7f0d3d098a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-24T17:24:19.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:19.188+0000 7f0d3d098a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-24T17:24:19.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:19.188+0000 7f0d3d098a40 -1 bdev(0x562c92b99800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:19.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:19.188+0000 7f0d3d098a40 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-24T17:24:20.054 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-24T17:24:20.102 DEBUG:teuthology.orchestra.run.trial094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-24T17:24:20.111 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:20.111 INFO:tasks.ceph:role: osd.1 2026-02-24T17:24:20.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:24:20.112 DEBUG:teuthology.orchestra.run.trial094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T17:24:20.168 INFO:teuthology.orchestra.run.trial094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:20.168 INFO:teuthology.orchestra.run.trial094.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:20.168 INFO:teuthology.orchestra.run.trial094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:20.169 INFO:teuthology.orchestra.run.trial094.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:20.169 INFO:teuthology.orchestra.run.trial094.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:20.169 INFO:teuthology.orchestra.run.trial094.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:20.169 INFO:teuthology.orchestra.run.trial094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:20.169 INFO:teuthology.orchestra.run.trial094.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:20.169 INFO:teuthology.orchestra.run.trial094.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:20.169 INFO:teuthology.orchestra.run.trial094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:20.751 INFO:teuthology.orchestra.run.trial094.stdout:Discarding blocks...Done. 2026-02-24T17:24:20.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial094.front.sepia.ceph.com -o noatime 2026-02-24T17:24:20.753 DEBUG:teuthology.orchestra.run.trial094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-24T17:24:20.808 DEBUG:teuthology.orchestra.run.trial094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-24T17:24:20.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:20.862 INFO:teuthology.orchestra.run.trial094.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:20.862 DEBUG:teuthology.orchestra.run.trial094:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-24T17:24:20.915 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:20.915 INFO:tasks.ceph:role: osd.5 2026-02-24T17:24:20.915 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:24:20.915 DEBUG:teuthology.orchestra.run.trial094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:20.968 INFO:teuthology.orchestra.run.trial094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:21.543 INFO:teuthology.orchestra.run.trial094.stdout:Discarding blocks...Done. 2026-02-24T17:24:21.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial094.front.sepia.ceph.com -o noatime 2026-02-24T17:24:21.545 DEBUG:teuthology.orchestra.run.trial094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-24T17:24:21.604 DEBUG:teuthology.orchestra.run.trial094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-24T17:24:21.652 INFO:teuthology.orchestra.run.trial094.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:21.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:21.652 DEBUG:teuthology.orchestra.run.trial094:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-24T17:24:21.703 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:21.703 INFO:tasks.ceph:role: osd.9 2026-02-24T17:24:21.703 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:24:21.703 DEBUG:teuthology.orchestra.run.trial094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:21.756 INFO:teuthology.orchestra.run.trial094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:22.319 INFO:teuthology.orchestra.run.trial094.stdout:Discarding blocks...Done. 2026-02-24T17:24:22.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial094.front.sepia.ceph.com -o noatime 2026-02-24T17:24:22.321 DEBUG:teuthology.orchestra.run.trial094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-24T17:24:22.376 DEBUG:teuthology.orchestra.run.trial094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-24T17:24:22.424 INFO:teuthology.orchestra.run.trial094.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:22.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:22.425 DEBUG:teuthology.orchestra.run.trial094:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-24T17:24:22.475 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:22.475 INFO:tasks.ceph:role: osd.13 2026-02-24T17:24:22.476 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:24:22.476 DEBUG:teuthology.orchestra.run.trial094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T17:24:22.528 INFO:teuthology.orchestra.run.trial094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:22.529 INFO:teuthology.orchestra.run.trial094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:23.089 INFO:teuthology.orchestra.run.trial094.stdout:Discarding blocks...Done. 2026-02-24T17:24:23.090 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial094.front.sepia.ceph.com -o noatime 2026-02-24T17:24:23.090 DEBUG:teuthology.orchestra.run.trial094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-24T17:24:23.153 DEBUG:teuthology.orchestra.run.trial094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-24T17:24:23.204 INFO:teuthology.orchestra.run.trial094.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:23.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:23.204 DEBUG:teuthology.orchestra.run.trial094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:23.268 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:23.268+0000 7f6450511a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-24T17:24:23.268 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:23.268+0000 7f6450511a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-24T17:24:23.268 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:23.268+0000 7f6450511a40 -1 bdev(0x562784c83800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:23.268 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:23.268+0000 7f6450511a40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-24T17:24:24.208 DEBUG:teuthology.orchestra.run.trial094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-24T17:24:24.259 DEBUG:teuthology.orchestra.run.trial094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:24.323 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:24.324+0000 7f091a1d6a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-24T17:24:24.324 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:24.324+0000 7f091a1d6a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-24T17:24:24.324 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:24.324+0000 7f091a1d6a40 -1 bdev(0x55c0d382d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:24.324 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:24.324+0000 7f091a1d6a40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-24T17:24:25.144 DEBUG:teuthology.orchestra.run.trial094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-24T17:24:25.195 DEBUG:teuthology.orchestra.run.trial094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:25.260 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:25.260+0000 7fb1f4c36a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-24T17:24:25.260 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:25.260+0000 7fb1f4c36a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-24T17:24:25.260 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:25.260+0000 7fb1f4c36a40 -1 bdev(0x56506f941800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:25.260 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:25.260+0000 7fb1f4c36a40 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-24T17:24:26.123 DEBUG:teuthology.orchestra.run.trial094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-24T17:24:26.179 DEBUG:teuthology.orchestra.run.trial094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:26.244 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:26.244+0000 7f6e31c84a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-24T17:24:26.246 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:26.244+0000 7f6e31c84a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-24T17:24:26.246 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:26.244+0000 7f6e31c84a40 -1 bdev(0x5583baa1b800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:26.246 INFO:teuthology.orchestra.run.trial094.stderr:2026-02-24T17:24:26.244+0000 7f6e31c84a40 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-24T17:24:27.108 DEBUG:teuthology.orchestra.run.trial094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-24T17:24:27.159 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-24T17:24:27.169 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:27.169 INFO:tasks.ceph:role: osd.2 2026-02-24T17:24:27.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:24:27.169 DEBUG:teuthology.orchestra.run.trial109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T17:24:27.221 INFO:teuthology.orchestra.run.trial109.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:27.221 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:27.221 INFO:teuthology.orchestra.run.trial109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:27.221 INFO:teuthology.orchestra.run.trial109.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:27.221 INFO:teuthology.orchestra.run.trial109.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:27.221 INFO:teuthology.orchestra.run.trial109.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:27.221 INFO:teuthology.orchestra.run.trial109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:27.221 INFO:teuthology.orchestra.run.trial109.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:27.222 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:27.222 INFO:teuthology.orchestra.run.trial109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:27.798 INFO:teuthology.orchestra.run.trial109.stdout:Discarding blocks...Done. 2026-02-24T17:24:27.800 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial109.front.sepia.ceph.com -o noatime 2026-02-24T17:24:27.800 DEBUG:teuthology.orchestra.run.trial109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-24T17:24:27.853 DEBUG:teuthology.orchestra.run.trial109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-24T17:24:27.900 INFO:teuthology.orchestra.run.trial109.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:27.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:27.900 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-24T17:24:27.951 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:27.951 INFO:tasks.ceph:role: osd.6 2026-02-24T17:24:27.951 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:24:27.951 DEBUG:teuthology.orchestra.run.trial109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:28.004 INFO:teuthology.orchestra.run.trial109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:28.575 INFO:teuthology.orchestra.run.trial109.stdout:Discarding blocks...Done. 2026-02-24T17:24:28.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial109.front.sepia.ceph.com -o noatime 2026-02-24T17:24:28.577 DEBUG:teuthology.orchestra.run.trial109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-24T17:24:28.635 DEBUG:teuthology.orchestra.run.trial109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-24T17:24:28.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:28.685 INFO:teuthology.orchestra.run.trial109.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:28.686 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-24T17:24:28.734 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:28.734 INFO:tasks.ceph:role: osd.10 2026-02-24T17:24:28.734 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:24:28.734 DEBUG:teuthology.orchestra.run.trial109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T17:24:28.784 INFO:teuthology.orchestra.run.trial109.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:28.784 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:28.784 INFO:teuthology.orchestra.run.trial109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:28.785 INFO:teuthology.orchestra.run.trial109.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:28.785 INFO:teuthology.orchestra.run.trial109.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:28.785 INFO:teuthology.orchestra.run.trial109.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:28.785 INFO:teuthology.orchestra.run.trial109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:28.785 INFO:teuthology.orchestra.run.trial109.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:28.785 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:28.785 INFO:teuthology.orchestra.run.trial109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:29.351 INFO:teuthology.orchestra.run.trial109.stdout:Discarding blocks...Done. 2026-02-24T17:24:29.353 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial109.front.sepia.ceph.com -o noatime 2026-02-24T17:24:29.353 DEBUG:teuthology.orchestra.run.trial109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-24T17:24:29.410 DEBUG:teuthology.orchestra.run.trial109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-24T17:24:29.459 INFO:teuthology.orchestra.run.trial109.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:29.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:29.460 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-24T17:24:29.510 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:29.510 INFO:tasks.ceph:role: osd.14 2026-02-24T17:24:29.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:24:29.510 DEBUG:teuthology.orchestra.run.trial109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:29.560 INFO:teuthology.orchestra.run.trial109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:30.123 INFO:teuthology.orchestra.run.trial109.stdout:Discarding blocks...Done. 2026-02-24T17:24:30.124 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial109.front.sepia.ceph.com -o noatime 2026-02-24T17:24:30.125 DEBUG:teuthology.orchestra.run.trial109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-24T17:24:30.182 DEBUG:teuthology.orchestra.run.trial109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-24T17:24:30.232 INFO:teuthology.orchestra.run.trial109.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:30.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:30.233 DEBUG:teuthology.orchestra.run.trial109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:30.300 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:30.296+0000 7f6f1cec9a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-24T17:24:30.300 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:30.296+0000 7f6f1cec9a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-24T17:24:30.300 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:30.296+0000 7f6f1cec9a40 -1 bdev(0x5569b3c81800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:30.300 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:30.296+0000 7f6f1cec9a40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-24T17:24:31.093 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-24T17:24:31.143 DEBUG:teuthology.orchestra.run.trial109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:31.208 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:31.204+0000 7f5325b5ba40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-24T17:24:31.208 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:31.204+0000 7f5325b5ba40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-24T17:24:31.208 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:31.204+0000 7f5325b5ba40 -1 bdev(0x557713c83800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:31.208 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:31.204+0000 7f5325b5ba40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-24T17:24:32.080 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-24T17:24:32.136 DEBUG:teuthology.orchestra.run.trial109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:32.201 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:32.196+0000 7f3727b5ba40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-24T17:24:32.201 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:32.196+0000 7f3727b5ba40 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-24T17:24:32.201 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:32.196+0000 7f3727b5ba40 -1 bdev(0x5638a0985800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:32.201 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:32.196+0000 7f3727b5ba40 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-24T17:24:33.033 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-24T17:24:33.082 DEBUG:teuthology.orchestra.run.trial109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:33.147 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:33.144+0000 7f4e8d7c9a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-24T17:24:33.148 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:33.144+0000 7f4e8d7c9a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-24T17:24:33.148 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:33.144+0000 7f4e8d7c9a40 -1 bdev(0x555ffeaff800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:33.148 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-24T17:24:33.144+0000 7f4e8d7c9a40 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-24T17:24:33.991 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-24T17:24:34.047 DEBUG:teuthology.orchestra.run.trial120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-24T17:24:34.056 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:34.056 INFO:tasks.ceph:role: osd.3 2026-02-24T17:24:34.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:24:34.056 DEBUG:teuthology.orchestra.run.trial120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:34.109 INFO:teuthology.orchestra.run.trial120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:34.693 INFO:teuthology.orchestra.run.trial120.stdout:Discarding blocks...Done. 2026-02-24T17:24:34.694 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial120.front.sepia.ceph.com -o noatime 2026-02-24T17:24:34.695 DEBUG:teuthology.orchestra.run.trial120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-24T17:24:34.752 DEBUG:teuthology.orchestra.run.trial120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-24T17:24:34.800 INFO:teuthology.orchestra.run.trial120.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:34.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:34.801 DEBUG:teuthology.orchestra.run.trial120:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-24T17:24:34.852 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:34.852 INFO:tasks.ceph:role: osd.7 2026-02-24T17:24:34.852 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:24:34.853 DEBUG:teuthology.orchestra.run.trial120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:34.905 INFO:teuthology.orchestra.run.trial120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:35.471 INFO:teuthology.orchestra.run.trial120.stdout:Discarding blocks...Done. 2026-02-24T17:24:35.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial120.front.sepia.ceph.com -o noatime 2026-02-24T17:24:35.474 DEBUG:teuthology.orchestra.run.trial120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-24T17:24:35.528 DEBUG:teuthology.orchestra.run.trial120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-24T17:24:35.577 INFO:teuthology.orchestra.run.trial120.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:35.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:35.577 DEBUG:teuthology.orchestra.run.trial120:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-24T17:24:35.627 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:35.628 INFO:tasks.ceph:role: osd.11 2026-02-24T17:24:35.628 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:24:35.628 DEBUG:teuthology.orchestra.run.trial120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T17:24:35.680 INFO:teuthology.orchestra.run.trial120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:35.680 INFO:teuthology.orchestra.run.trial120.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:35.680 INFO:teuthology.orchestra.run.trial120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:35.681 INFO:teuthology.orchestra.run.trial120.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:35.681 INFO:teuthology.orchestra.run.trial120.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:35.681 INFO:teuthology.orchestra.run.trial120.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:35.681 INFO:teuthology.orchestra.run.trial120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:35.681 INFO:teuthology.orchestra.run.trial120.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:35.681 INFO:teuthology.orchestra.run.trial120.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:35.681 INFO:teuthology.orchestra.run.trial120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:36.248 INFO:teuthology.orchestra.run.trial120.stdout:Discarding blocks...Done. 2026-02-24T17:24:36.251 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial120.front.sepia.ceph.com -o noatime 2026-02-24T17:24:36.251 DEBUG:teuthology.orchestra.run.trial120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-24T17:24:36.309 DEBUG:teuthology.orchestra.run.trial120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-24T17:24:36.357 INFO:teuthology.orchestra.run.trial120.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:36.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:36.357 DEBUG:teuthology.orchestra.run.trial120:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-24T17:24:36.408 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T17:24:36.408 INFO:tasks.ceph:role: osd.15 2026-02-24T17:24:36.408 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:24:36.408 DEBUG:teuthology.orchestra.run.trial120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T17:24:36.461 INFO:teuthology.orchestra.run.trial120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T17:24:36.461 INFO:teuthology.orchestra.run.trial120.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T17:24:36.461 INFO:teuthology.orchestra.run.trial120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T17:24:36.461 INFO:teuthology.orchestra.run.trial120.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-24T17:24:36.461 INFO:teuthology.orchestra.run.trial120.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T17:24:36.461 INFO:teuthology.orchestra.run.trial120.stdout: = sunit=0 swidth=0 blks 2026-02-24T17:24:36.462 INFO:teuthology.orchestra.run.trial120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T17:24:36.462 INFO:teuthology.orchestra.run.trial120.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T17:24:36.462 INFO:teuthology.orchestra.run.trial120.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T17:24:36.462 INFO:teuthology.orchestra.run.trial120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T17:24:37.024 INFO:teuthology.orchestra.run.trial120.stdout:Discarding blocks...Done. 2026-02-24T17:24:37.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial120.front.sepia.ceph.com -o noatime 2026-02-24T17:24:37.026 DEBUG:teuthology.orchestra.run.trial120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-24T17:24:37.080 DEBUG:teuthology.orchestra.run.trial120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-24T17:24:37.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:24:37.130 INFO:teuthology.orchestra.run.trial120.stderr:sudo: /sbin/restorecon: command not found 2026-02-24T17:24:37.131 DEBUG:teuthology.orchestra.run.trial120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:37.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:37.190+0000 7f2f55d81a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-24T17:24:37.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:37.190+0000 7f2f55d81a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-24T17:24:37.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:37.190+0000 7f2f55d81a40 -1 bdev(0x55ad2c33b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:37.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:37.190+0000 7f2f55d81a40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-24T17:24:37.989 DEBUG:teuthology.orchestra.run.trial120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-24T17:24:38.039 DEBUG:teuthology.orchestra.run.trial120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:38.106 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:38.102+0000 7fe17792fa40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-24T17:24:38.106 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:38.102+0000 7fe17792fa40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-24T17:24:38.106 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:38.102+0000 7fe17792fa40 -1 bdev(0x55f9c72f7800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:38.106 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:38.102+0000 7fe17792fa40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-24T17:24:38.944 DEBUG:teuthology.orchestra.run.trial120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-24T17:24:38.996 DEBUG:teuthology.orchestra.run.trial120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:39.061 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:39.058+0000 7f0e2363ea40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-24T17:24:39.061 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:39.058+0000 7f0e2363ea40 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-24T17:24:39.061 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:39.058+0000 7f0e2363ea40 -1 bdev(0x55fdd52cd800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:39.061 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:39.058+0000 7f0e2363ea40 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-24T17:24:39.917 DEBUG:teuthology.orchestra.run.trial120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-24T17:24:39.968 DEBUG:teuthology.orchestra.run.trial120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:40.033 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:40.030+0000 7fab34428a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-24T17:24:40.033 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:40.030+0000 7fab34428a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-24T17:24:40.033 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:40.030+0000 7fab34428a40 -1 bdev(0x56026bf65800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-24T17:24:40.033 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:40.030+0000 7fab34428a40 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-24T17:24:40.857 DEBUG:teuthology.orchestra.run.trial120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-24T17:24:40.908 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-24T17:24:40.908 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:40.908 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-24T17:24:40.919 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:40.919 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-24T17:24:40.970 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:40.970 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-24T17:24:41.018 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:41.019 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-24T17:24:41.068 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:41.068 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-24T17:24:41.120 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:41.120 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-24T17:24:41.131 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:41.131 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-24T17:24:41.183 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:41.184 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-24T17:24:41.234 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:41.234 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-24T17:24:41.282 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:41.282 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-24T17:24:41.293 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:41.293 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-24T17:24:41.343 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:41.343 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-24T17:24:41.396 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:41.396 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-24T17:24:41.447 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:41.447 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-24T17:24:41.457 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:41.457 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-24T17:24:41.508 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:41.508 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-24T17:24:41.560 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:41.560 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-24T17:24:41.612 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:41.613 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-24T17:24:41.663 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:41.663 DEBUG:teuthology.orchestra.run.trial120:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-24T17:24:41.710 INFO:tasks.ceph:Adding keys to all mons... 2026-02-24T17:24:41.711 DEBUG:teuthology.orchestra.run.trial040:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T17:24:41.712 DEBUG:teuthology.orchestra.run.trial094:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T17:24:41.714 DEBUG:teuthology.orchestra.run.trial109:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T17:24:41.718 INFO:teuthology.orchestra.run.trial040.stdout:[mgr.y] 2026-02-24T17:24:41.718 INFO:teuthology.orchestra.run.trial040.stdout: key = AQC93p1pMbWqBxAAXBp4EIvsWSu0V8wgN6MH3Q== 2026-02-24T17:24:41.718 INFO:teuthology.orchestra.run.trial040.stdout:[osd.0] 2026-02-24T17:24:41.718 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDA3p1pBm4WFhAAHLof4cR+tlaJSCoiD7dakQ== 2026-02-24T17:24:41.718 INFO:teuthology.orchestra.run.trial040.stdout:[osd.4] 2026-02-24T17:24:41.718 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDB3p1peAGNEBAAj+k9lGoeU9J/u5HiyQ/+bQ== 2026-02-24T17:24:41.718 INFO:teuthology.orchestra.run.trial040.stdout:[osd.8] 2026-02-24T17:24:41.718 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDC3p1p5ieFDRAA1HO3pk//U7pssgePQ55Gsw== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.12] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDD3p1piPpSCxAAgR8/85+FGhzyx6oWc6Qc7w== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.1] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDH3p1prsIwEBAAzFnoxYoYnmixG0+lqFbPFw== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.5] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDI3p1p9OF/ExAAictMZ/LScr+UAHXTd/nzIg== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.9] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDJ3p1pY/+3DxAAWtmKyo3yP6i0g7cRz6nTSA== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.13] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDK3p1pgtjLDhAAKHE0BXJP+2XyI4jhplt7Cg== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.2] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDO3p1pKgf/ERAALNXdHcPXdJcgc5KqseJiKQ== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.6] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDP3p1pFj9/DBAAiltcXl9XKJo+5NrD7YpOgg== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.10] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDQ3p1poRsJDBAAvE8Bb2tNGb+2lrdnSjW97A== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[osd.14] 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDR3p1pJuDmCBAAPxUEnVaKHkPcAtWuO/nK3g== 2026-02-24T17:24:41.719 INFO:teuthology.orchestra.run.trial040.stdout:[mgr.x] 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout: key = AQC93p1pOMeGChAAjEWd3Eai5TCSDWgUZ/EhUQ== 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout:[osd.3] 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDV3p1pD7CaCxAAwEXjZ+ha9gM2bZ1agqULDA== 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout:[osd.7] 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDW3p1p4V1PBhAAS3m0DTMv5rnSK58uiwZHhg== 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout:[osd.11] 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDX3p1pR92vAxAAJBInyMf1JdSf9a2oxHSP5A== 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout:[osd.15] 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDY3p1pvYkIAhAAbULSxYcNGUguSTdh3hCnmw== 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout:[client.0] 2026-02-24T17:24:41.720 INFO:teuthology.orchestra.run.trial040.stdout: key = AQC93p1pFtgoDhAA87JQHGWFSpYh3ywlAVVpoA== 2026-02-24T17:24:41.721 INFO:teuthology.orchestra.run.trial094.stdout:[mgr.y] 2026-02-24T17:24:41.721 INFO:teuthology.orchestra.run.trial094.stdout: key = AQC93p1pMbWqBxAAXBp4EIvsWSu0V8wgN6MH3Q== 2026-02-24T17:24:41.721 INFO:teuthology.orchestra.run.trial094.stdout:[osd.0] 2026-02-24T17:24:41.721 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDA3p1pBm4WFhAAHLof4cR+tlaJSCoiD7dakQ== 2026-02-24T17:24:41.721 INFO:teuthology.orchestra.run.trial094.stdout:[osd.4] 2026-02-24T17:24:41.721 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDB3p1peAGNEBAAj+k9lGoeU9J/u5HiyQ/+bQ== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.8] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDC3p1p5ieFDRAA1HO3pk//U7pssgePQ55Gsw== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.12] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDD3p1piPpSCxAAgR8/85+FGhzyx6oWc6Qc7w== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.1] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDH3p1prsIwEBAAzFnoxYoYnmixG0+lqFbPFw== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.5] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDI3p1p9OF/ExAAictMZ/LScr+UAHXTd/nzIg== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.9] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDJ3p1pY/+3DxAAWtmKyo3yP6i0g7cRz6nTSA== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.13] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDK3p1pgtjLDhAAKHE0BXJP+2XyI4jhplt7Cg== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.2] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDO3p1pKgf/ERAALNXdHcPXdJcgc5KqseJiKQ== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.6] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDP3p1pFj9/DBAAiltcXl9XKJo+5NrD7YpOgg== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.10] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDQ3p1poRsJDBAAvE8Bb2tNGb+2lrdnSjW97A== 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout:[osd.14] 2026-02-24T17:24:41.722 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDR3p1pJuDmCBAAPxUEnVaKHkPcAtWuO/nK3g== 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout:[mgr.x] 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout: key = AQC93p1pOMeGChAAjEWd3Eai5TCSDWgUZ/EhUQ== 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout:[osd.3] 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDV3p1pD7CaCxAAwEXjZ+ha9gM2bZ1agqULDA== 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout:[osd.7] 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDW3p1p4V1PBhAAS3m0DTMv5rnSK58uiwZHhg== 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout:[osd.11] 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDX3p1pR92vAxAAJBInyMf1JdSf9a2oxHSP5A== 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout:[osd.15] 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout: key = AQDY3p1pvYkIAhAAbULSxYcNGUguSTdh3hCnmw== 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout:[client.0] 2026-02-24T17:24:41.723 INFO:teuthology.orchestra.run.trial094.stdout: key = AQC93p1pFtgoDhAA87JQHGWFSpYh3ywlAVVpoA== 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout:[mgr.y] 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout: key = AQC93p1pMbWqBxAAXBp4EIvsWSu0V8wgN6MH3Q== 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout:[osd.0] 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDA3p1pBm4WFhAAHLof4cR+tlaJSCoiD7dakQ== 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout:[osd.4] 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDB3p1peAGNEBAAj+k9lGoeU9J/u5HiyQ/+bQ== 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout:[osd.8] 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDC3p1p5ieFDRAA1HO3pk//U7pssgePQ55Gsw== 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout:[osd.12] 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDD3p1piPpSCxAAgR8/85+FGhzyx6oWc6Qc7w== 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout:[osd.1] 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDH3p1prsIwEBAAzFnoxYoYnmixG0+lqFbPFw== 2026-02-24T17:24:41.724 INFO:teuthology.orchestra.run.trial109.stdout:[osd.5] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDI3p1p9OF/ExAAictMZ/LScr+UAHXTd/nzIg== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.9] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDJ3p1pY/+3DxAAWtmKyo3yP6i0g7cRz6nTSA== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.13] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDK3p1pgtjLDhAAKHE0BXJP+2XyI4jhplt7Cg== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.2] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDO3p1pKgf/ERAALNXdHcPXdJcgc5KqseJiKQ== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.6] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDP3p1pFj9/DBAAiltcXl9XKJo+5NrD7YpOgg== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.10] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDQ3p1poRsJDBAAvE8Bb2tNGb+2lrdnSjW97A== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.14] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDR3p1pJuDmCBAAPxUEnVaKHkPcAtWuO/nK3g== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[mgr.x] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQC93p1pOMeGChAAjEWd3Eai5TCSDWgUZ/EhUQ== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.3] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDV3p1pD7CaCxAAwEXjZ+ha9gM2bZ1agqULDA== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.7] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDW3p1p4V1PBhAAS3m0DTMv5rnSK58uiwZHhg== 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout:[osd.11] 2026-02-24T17:24:41.725 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDX3p1pR92vAxAAJBInyMf1JdSf9a2oxHSP5A== 2026-02-24T17:24:41.726 INFO:teuthology.orchestra.run.trial109.stdout:[osd.15] 2026-02-24T17:24:41.726 INFO:teuthology.orchestra.run.trial109.stdout: key = AQDY3p1pvYkIAhAAbULSxYcNGUguSTdh3hCnmw== 2026-02-24T17:24:41.726 INFO:teuthology.orchestra.run.trial109.stdout:[client.0] 2026-02-24T17:24:41.726 INFO:teuthology.orchestra.run.trial109.stdout: key = AQC93p1pFtgoDhAA87JQHGWFSpYh3ywlAVVpoA== 2026-02-24T17:24:41.726 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T17:24:41.763 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T17:24:41.764 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T17:24:41.807 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:41.852 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:41.854 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:41.876 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:41.912 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:41.916 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:41.939 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:41.977 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:41.980 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.004 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.039 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.047 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.068 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.103 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.112 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.133 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.163 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.175 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.196 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.224 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.240 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.261 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.288 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.303 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.325 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.348 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.368 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.392 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.412 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.432 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.459 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.476 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.496 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.522 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.539 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.561 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.587 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T17:24:42.604 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T17:24:42.623 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T17:24:42.651 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.667 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.688 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.720 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.732 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.752 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.784 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.796 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.817 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.848 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.860 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.880 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T17:24:42.915 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T17:24:42.924 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T17:24:42.944 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T17:24:42.981 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-24T17:24:42.981 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-24T17:24:42.994 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T17:24:43.065 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-24T17:24:43.120 DEBUG:teuthology.orchestra.run.trial094:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-24T17:24:43.130 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T17:24:43.201 DEBUG:teuthology.orchestra.run.trial094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-24T17:24:43.250 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-24T17:24:43.259 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T17:24:43.337 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-24T17:24:43.386 DEBUG:teuthology.orchestra.run.trial040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:43.387 DEBUG:teuthology.orchestra.run.trial094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:43.389 DEBUG:teuthology.orchestra.run.trial109:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T17:24:43.430 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-24T17:24:43.431 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-24T17:24:43.431 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-24T17:24:43.433 INFO:tasks.ceph.mon.a:Started 2026-02-24T17:24:43.433 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-24T17:24:43.433 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-24T17:24:43.436 INFO:tasks.ceph.mon.b:Started 2026-02-24T17:24:43.436 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-24T17:24:43.436 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-24T17:24:43.475 INFO:tasks.ceph.mon.c:Started 2026-02-24T17:24:43.475 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-24T17:24:43.475 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-24T17:24:43.475 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-24T17:24:43.476 INFO:tasks.ceph.mgr.y:Started 2026-02-24T17:24:43.477 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-24T17:24:43.477 DEBUG:teuthology.orchestra.run.trial120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-24T17:24:43.478 INFO:tasks.ceph.mgr.x:Started 2026-02-24T17:24:43.478 DEBUG:tasks.ceph:set 0 configs 2026-02-24T17:24:43.478 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph config dump 2026-02-24T17:24:43.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.528+0000 7fb388dd2640 1 Processor -- start 2026-02-24T17:24:43.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb388dd2640 1 -- start start 2026-02-24T17:24:43.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb388dd2640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:43.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb388dd2640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb38416e870 con 0x7fb384161c70 2026-02-24T17:24:43.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb388dd2640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb38416eb50 con 0x7fb3841618a0 2026-02-24T17:24:43.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb388dd2640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fb38416e620 con 0x7fb38416ba90 2026-02-24T17:24:43.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb381d74640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7fb384161c70 0x7fb3840b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:35002/0 (socket says 10.20.193.40:35002) 2026-02-24T17:24:43.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 learned_addr learned my addr 10.20.193.40:0/1595441212 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:24:43.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:43.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:43.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:43.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:43.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:24:43.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:43.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.736+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:43.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.736+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:43.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:43.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:43.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T17:24:44.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:44.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.140+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:44.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.140+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:44.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:44.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T17:24:44.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:44.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.944+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:44.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.944+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:44.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:44.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:44.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T17:24:46.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 msgr2=0x7fb3840b3890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:24:46.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb38416ba90 0x7fb3840b3890 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:46.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v1:10.20.193.109:6789/0 conn(0x7fb3841618a0 legacy=0x7fb38416b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:46.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v1:10.20.193.94:6789/0 conn(0x7fb384161c70 legacy=0x7fb3840b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:46.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:46.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb38416ee30 con 0x7fb360024240 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb38416e620 con 0x7fb3600037f0 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb360067ca0 con 0x7fb360045fc0 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:46.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:46.543 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:24:46.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:46.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:46.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:46.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:46.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T17:24:46.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:46.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:46.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:46.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:46.745 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:46.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=START_CONNECT pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=START_CONNECT pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:47.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:47.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=START_CONNECT pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T17:24:47.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:47.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:47.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:47.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:47.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=START_CONNECT pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T17:24:47.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:47.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:47.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:47.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:47.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:47.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=START_CONNECT pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T17:24:49.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 msgr2=0x7fb360066470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:24:49.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360045fc0 0x7fb360066470 unknown :-1 s=START_CONNECT pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:49.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 msgr2=0x7fb360023bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:24:49.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb3600037f0 0x7fb360023bf0 unknown :-1 s=START_CONNECT pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:49.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v1:10.20.193.40:6789/0 conn(0x7fb360024240 legacy=0x7fb3600446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:49.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 reap_dead start 2026-02-24T17:24:49.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:49.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb360067f60 con 0x7fb360066d50 2026-02-24T17:24:49.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb360067980 con 0x7fb360023bd0 2026-02-24T17:24:49.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb38416e620 con 0x7fb360047450 2026-02-24T17:24:49.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:49.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:49.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:49.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:49.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.532+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=START_CONNECT pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:24:49.743 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:49.743 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.736+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:49.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.736+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:49.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:49.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:49.736+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=START_CONNECT pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T17:24:50.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:50.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.140+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:50.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.140+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:50.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:50.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.140+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=START_CONNECT pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T17:24:50.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:50.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.944+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:50.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.944+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:50.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:50.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:50.944+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=START_CONNECT pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 msgr2=0x7fb3600478f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.40:3300/0 conn(0x7fb360047450 0x7fb3600478f0 unknown :-1 s=START_CONNECT pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v1:10.20.193.109:6789/0 conn(0x7fb360023bd0 legacy=0x7fb360044670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 >> v1:10.20.193.40:6789/0 conn(0x7fb360066d50 legacy=0x7fb360067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb360049ea0 con 0x7fb3600495c0 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb38416e620 con 0x7fb360048010 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb36bfff640 1 -- 10.20.193.40:0/1595441212 --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fb360067ca0 con 0x7fb360048ab0 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:52.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:52.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 msgr2=0x7fb3600483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:52.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 msgr2=0x7fb3600483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:52.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:52.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=START_CONNECT pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:24:52.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 msgr2=0x7fb360048ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-24T17:24:52.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 msgr2=0x7fb360048ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:52.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:52.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.532+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=START_CONNECT pgs=0 gs=42 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 msgr2=0x7fb3600483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 msgr2=0x7fb3600483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=START_CONNECT pgs=0 gs=45 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 msgr2=0x7fb360048ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 msgr2=0x7fb360048ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:52.744 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:52.736+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=START_CONNECT pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 msgr2=0x7fb3600483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb382575640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 msgr2=0x7fb3600483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=START_CONNECT pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 msgr2=0x7fb360048ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 msgr2=0x7fb360048ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:53.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.140+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T17:24:53.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.772+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331181112 0 0) 0x7fb360049ea0 con 0x7fb3600495c0 2026-02-24T17:24:53.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.772+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb370003620 con 0x7fb3600495c0 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 <== mon.1 v1:10.20.193.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2533564111 0 0) 0x7fb370003620 con 0x7fb3600495c0 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 msgr2=0x7fb360048ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.109:3300/0 conn(0x7fb360048ab0 0x7fb360048ed0 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 msgr2=0x7fb3600483e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 --2- 10.20.193.40:0/1595441212 >> v2:10.20.193.94:3300/0 conn(0x7fb360048010 0x7fb3600483e0 unknown :-1 s=START_CONNECT pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 --> v1:10.20.193.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb360049c70 con 0x7fb3600495c0 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb382d76640 1 -- 10.20.193.40:0/1595441212 reap_dead start 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 <== mon.1 v1:10.20.193.94:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7fb37400ab30 con 0x7fb3600495c0 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 >> v1:10.20.193.94:6789/0 conn(0x7fb3600495c0 legacy=0x7fb36004a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb370003ab0 0x7fb370003ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3700048d0 0x7fb370004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370005280 0x7fb370065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb38416e620 con 0x7fb3700048d0 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb360067ca0 con 0x7fb370005280 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb370066240 con 0x7fb370003ab0 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3700048d0 0x7fb370004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=52 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb382575640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb370003ab0 0x7fb370003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb382d76640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370005280 0x7fb370065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=53 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb370003ab0 msgr2=0x7fb370003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:53.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb370003ab0 0x7fb370003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370005280 msgr2=0x7fb370065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:53.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370005280 0x7fb370065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=53 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381d74640 1 -- 10.20.193.40:0/1595441212 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb370003620 con 0x7fb3700048d0 2026-02-24T17:24:53.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381d74640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3700048d0 0x7fb370004d40 secure :-1 s=READY pgs=20 gs=52 cs=0 l=1 c_cookie=11751523697045434973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb360045ed0 tx=0x7fb36c01ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a315cc8a4bfa725d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb36c0ae020 con 0x7fb3700048d0 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c0a66a0 con 0x7fb3700048d0 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb381573640 1 -- 10.20.193.40:0/1595441212 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb36c005d60 con 0x7fb3700048d0 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 -- 10.20.193.40:0/1595441212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3700048d0 msgr2=0x7fb370004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3700048d0 0x7fb370004d40 secure :-1 s=READY pgs=20 gs=52 cs=0 l=1 c_cookie=11751523697045434973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb360045ed0 tx=0x7fb36c01ccb0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 -- 10.20.193.40:0/1595441212 shutdown_connections 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370005280 0x7fb370065a90 unknown :-1 s=CLOSED pgs=0 gs=53 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3700048d0 0x7fb370004d40 unknown :-1 s=CLOSED pgs=20 gs=52 cs=0 l=1 c_cookie=11751523697045434973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 --2- 10.20.193.40:0/1595441212 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb370003ab0 0x7fb370003ec0 unknown :-1 s=CLOSED pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 -- 10.20.193.40:0/1595441212 >> 10.20.193.40:0/1595441212 conn(0x7fb3840b8fd0 msgr2=0x7fb3840b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 -- 10.20.193.40:0/1595441212 shutdown_connections 2026-02-24T17:24:53.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.776+0000 7fb388dd2640 1 -- 10.20.193.40:0/1595441212 wait complete. 2026-02-24T17:24:53.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 librados: starting msgr at 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 librados: starting objecter 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 Processor -- start 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 -- start start 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 librados: setting wanted keys 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 librados: calling monclient init 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3600495c0 0x7fb38411b500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370003ab0 0x7fb38411ea80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb3700048d0 0x7fb3841695a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb3840b2c30 con 0x7fb3600495c0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb3840b2ab0 con 0x7fb370003ab0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb3840b3ef0 con 0x7fb3700048d0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3600495c0 0x7fb38411b500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3600495c0 0x7fb38411b500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55904/0 (socket says 10.20.193.40:55904) 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 -- 10.20.193.40:0/236917697 learned_addr learned my addr 10.20.193.40:0/236917697 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb381d74640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370003ab0 0x7fb38411ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382d76640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb3700048d0 0x7fb3841695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 -- 10.20.193.40:0/236917697 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb3700048d0 msgr2=0x7fb3841695a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb3700048d0 0x7fb3841695a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 -- 10.20.193.40:0/236917697 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370003ab0 msgr2=0x7fb38411ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370003ab0 0x7fb38411ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 -- 10.20.193.40:0/236917697 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38411ba40 con 0x7fb3600495c0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb382575640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3600495c0 0x7fb38411b500 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb378007ed0 tx=0x7fb378016a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 10 client.?.objecter ms_handle_connect 0x7fb3600495c0 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:53.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 1 -- 10.20.193.40:0/236917697 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb378015a40 con 0x7fb3600495c0 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 1 -- 10.20.193.40:0/236917697 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb378015be0 con 0x7fb3600495c0 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 1 -- 10.20.193.40:0/236917697 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb378020420 con 0x7fb3600495c0 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38411f320 con 0x7fb3600495c0 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 10 client.4104.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38411f8e0 con 0x7fb3600495c0 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 librados: init done 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 1 -- 10.20.193.40:0/236917697 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fb3780209d0 con 0x7fb3600495c0 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 1 -- 10.20.193.40:0/236917697 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fb37801c030 con 0x7fb3600495c0 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 10 client.4104.objecter ms_dispatch2 0x7fb384000ba0 osd_map(1..1 src has 1..1) 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 3 client.4104.objecter handle_osd_map got epochs [1,1] > 0 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 3 client.4104.objecter handle_osd_map decoding full epoch 1 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb36affd640 20 client.4104.objecter dump_active .. 0 homeless 2026-02-24T17:24:53.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.780+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3840b42e0 con 0x7fb3600495c0 2026-02-24T17:24:53.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.784+0000 7fb36affd640 1 -- 10.20.193.40:0/236917697 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7fb37802a470 con 0x7fb3600495c0 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb3841656d0 con 0x7fb3600495c0 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb36affd640 1 -- 10.20.193.40:0/236917697 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (secure 0 0 0) 0x7fb37802a710 con 0x7fb3600495c0 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 10 librados: watch_flush enter 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 10 librados: watch_flush exit 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 20 client.4104.objecter shutdown clearing up homeless session... 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 10 client.4104.objecter successfully canceled tick 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3600495c0 msgr2=0x7fb38411b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3600495c0 0x7fb38411b500 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb378007ed0 tx=0x7fb378016a80 comp rx=0 tx=0).stop 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 shutdown_connections 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb3700048d0 0x7fb3841695a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb370003ab0 0x7fb38411ea80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 --2- 10.20.193.40:0/236917697 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb3600495c0 0x7fb38411b500 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 >> 10.20.193.40:0/236917697 conn(0x7fb3840b8fd0 msgr2=0x7fb38413e020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:53.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 shutdown_connections 2026-02-24T17:24:53.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 -- 10.20.193.40:0/236917697 wait complete. 2026-02-24T17:24:53.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.824+0000 7fb388dd2640 1 librados: shutdown 2026-02-24T17:24:53.846 INFO:tasks.ceph:Setting crush tunables to jewel 2026-02-24T17:24:53.846 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd crush tunables jewel 2026-02-24T17:24:53.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a19315640 1 Processor -- start 2026-02-24T17:24:53.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a19315640 1 -- start start 2026-02-24T17:24:53.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a19315640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f7a1415d740 0x7f7a140b5720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a19315640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f7a140b3c40 0x7f7a1405db40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a19315640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a140b28c0 con 0x7f7a1415d370 2026-02-24T17:24:53.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a19315640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7a140b37b0 con 0x7f7a140b3c40 2026-02-24T17:24:53.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a19315640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f7a140b2ba0 con 0x7f7a1415d740 2026-02-24T17:24:53.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a137fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f7a140b3c40 0x7f7a1405db40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a137fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f7a140b3c40 0x7f7a1405db40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55908/0 (socket says 10.20.193.40:55908) 2026-02-24T17:24:53.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a137fe640 1 -- 10.20.193.40:0/2468052365 learned_addr learned my addr 10.20.193.40:0/2468052365 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:24:53.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a127fc640 1 --2- 10.20.193.40:0/2468052365 >> v2:10.20.193.109:3300/0 conn(0x7f7a1415d740 0x7f7a140b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a137fe640 1 -- 10.20.193.40:0/2468052365 >> v2:10.20.193.109:3300/0 conn(0x7f7a1415d740 msgr2=0x7f7a140b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:53.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a137fe640 1 --2- 10.20.193.40:0/2468052365 >> v2:10.20.193.109:3300/0 conn(0x7f7a1415d740 0x7f7a140b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a137fe640 1 -- 10.20.193.40:0/2468052365 >> v1:10.20.193.94:6789/0 conn(0x7f7a1415d370 legacy=0x7f7a140b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.896+0000 7f7a137fe640 1 -- 10.20.193.40:0/2468052365 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a140b2e80 con 0x7f7a140b3c40 2026-02-24T17:24:53.912 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a137fe640 1 --2- 10.20.193.40:0/2468052365 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a140b3c40 0x7f7a1405db40 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=5867558918634363386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a140b1d30 tx=0x7f7a0401d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516dc1bfb3e059fa server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:53.912 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a11ffb640 1 -- 10.20.193.40:0/2468052365 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a040b3070 con 0x7f7a140b3c40 2026-02-24T17:24:53.912 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a11ffb640 1 -- 10.20.193.40:0/2468052365 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a040a6a40 con 0x7f7a140b3c40 2026-02-24T17:24:53.912 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a11ffb640 1 -- 10.20.193.40:0/2468052365 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a040a6e50 con 0x7f7a140b3c40 2026-02-24T17:24:53.912 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- 10.20.193.40:0/2468052365 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a140b3c40 msgr2=0x7f7a1405db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 --2- 10.20.193.40:0/2468052365 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a140b3c40 0x7f7a1405db40 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=5867558918634363386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a140b1d30 tx=0x7f7a0401d960 comp rx=0 tx=0).stop 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- 10.20.193.40:0/2468052365 shutdown_connections 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 --2- 10.20.193.40:0/2468052365 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a140b3c40 0x7f7a1405db40 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=5867558918634363386 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 --2- 10.20.193.40:0/2468052365 >> v2:10.20.193.109:3300/0 conn(0x7f7a1415d740 0x7f7a140b5720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- 10.20.193.40:0/2468052365 >> 10.20.193.40:0/2468052365 conn(0x7f7a140bae80 msgr2=0x7f7a140bb280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- 10.20.193.40:0/2468052365 shutdown_connections 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- 10.20.193.40:0/2468052365 wait complete. 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 librados: starting msgr at 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 librados: starting objecter 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 Processor -- start 2026-02-24T17:24:53.913 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- start start 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 librados: setting wanted keys 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 librados: calling monclient init 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7a140b3c40 0x7f7a140b7950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a1415d370 0x7f7a1417a5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7a1417ab30 0x7f7a1417c330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14167520 con 0x7f7a1415d370 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1405e490 con 0x7f7a140b3c40 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7a141676a0 con 0x7f7a1417ab30 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a1415d370 0x7f7a1417a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a1415d370 0x7f7a1417a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55920/0 (socket says 10.20.193.40:55920) 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 -- 10.20.193.40:0/4019153604 learned_addr learned my addr 10.20.193.40:0/4019153604 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:24:53.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a12ffd640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7a140b3c40 0x7f7a140b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a137fe640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7a1417ab30 0x7f7a1417c330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 -- 10.20.193.40:0/4019153604 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7a1417ab30 msgr2=0x7f7a1417c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7a1417ab30 0x7f7a1417c330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 -- 10.20.193.40:0/4019153604 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7a140b3c40 msgr2=0x7f7a140b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7a140b3c40 0x7f7a140b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 -- 10.20.193.40:0/4019153604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a14139250 con 0x7f7a1415d370 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a127fc640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a1415d370 0x7f7a1417a5f0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79fc006b80 tx=0x7f79fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 10 client.?.objecter ms_handle_connect 0x7f7a1415d370 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 1 -- 10.20.193.40:0/4019153604 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79fc017020 con 0x7f7a1415d370 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 1 -- 10.20.193.40:0/4019153604 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc004250 con 0x7f7a1415d370 2026-02-24T17:24:53.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a14139530 con 0x7f7a1415d370 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 1 -- 10.20.193.40:0/4019153604 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79fc00f040 con 0x7f7a1415d370 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 10 client.4110.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a14139af0 con 0x7f7a1415d370 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 librados: init done 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 1 -- 10.20.193.40:0/4019153604 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f79fc012050 con 0x7f7a1415d370 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 1 -- 10.20.193.40:0/4019153604 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7f79fc013460 con 0x7f7a1415d370 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 10 client.4110.objecter ms_dispatch2 0x7f7a14000ba0 osd_map(1..1 src has 1..1) 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 3 client.4110.objecter handle_osd_map got epochs [1,1] > 0 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 3 client.4110.objecter handle_osd_map decoding full epoch 1 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f79f37fe640 20 client.4110.objecter dump_active .. 0 homeless 2026-02-24T17:24:53.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.900+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1405db40 con 0x7f7a1415d370 2026-02-24T17:24:53.917 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.904+0000 7f79f37fe640 1 -- 10.20.193.40:0/4019153604 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f79fc021020 con 0x7f7a1415d370 2026-02-24T17:24:53.942 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.932+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "jewel"} v 0) -- 0x7f7a1417a210 con 0x7f7a1415d370 2026-02-24T17:24:53.944 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.932+0000 7f79f37fe640 1 -- 10.20.193.40:0/4019153604 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "jewel"}]=0 adjusted tunables profile to jewel v2) ==== 120+0+0 (secure 0 0 0) 0x7f79fc003b80 con 0x7f7a1415d370 2026-02-24T17:24:53.944 INFO:teuthology.orchestra.run.trial040.stderr:adjusted tunables profile to jewel 2026-02-24T17:24:53.944 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 10 librados: watch_flush enter 2026-02-24T17:24:53.944 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 10 librados: watch_flush exit 2026-02-24T17:24:53.944 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 20 client.4110.objecter shutdown clearing up homeless session... 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 10 client.4110.objecter successfully canceled tick 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a1415d370 msgr2=0x7f7a1417a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a1415d370 0x7f7a1417a5f0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79fc006b80 tx=0x7f79fc00ec70 comp rx=0 tx=0).stop 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 shutdown_connections 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7a1417ab30 0x7f7a1417c330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7a1415d370 0x7f7a1417a5f0 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 --2- 10.20.193.40:0/4019153604 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7a140b3c40 0x7f7a140b7950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 >> 10.20.193.40:0/4019153604 conn(0x7f7a140bae80 msgr2=0x7f7a140bb250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 shutdown_connections 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 -- 10.20.193.40:0/4019153604 wait complete. 2026-02-24T17:24:53.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:53.936+0000 7f7a19315640 1 librados: shutdown 2026-02-24T17:24:53.952 INFO:tasks.ceph:check_enable_crimson: False 2026-02-24T17:24:53.953 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-24T17:24:53.953 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:53.953 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-24T17:24:53.962 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:53.962 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-24T17:24:54.014 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:54.014 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-24T17:24:54.062 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-24T17:24:54.062 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-24T17:24:54.110 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:54.110 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-24T17:24:54.120 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:54.121 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-24T17:24:54.171 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:54.171 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-24T17:24:54.224 DEBUG:teuthology.orchestra.run.trial094:> set -ex 2026-02-24T17:24:54.224 DEBUG:teuthology.orchestra.run.trial094:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-24T17:24:54.275 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:54.275 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-24T17:24:54.286 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:54.286 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-24T17:24:54.334 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:54.334 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-24T17:24:54.382 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-24T17:24:54.382 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-24T17:24:54.429 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:54.429 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-24T17:24:54.437 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:54.437 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-24T17:24:54.487 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:54.488 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-24T17:24:54.535 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:24:54.535 DEBUG:teuthology.orchestra.run.trial120:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-24T17:24:54.582 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new a63c8bf5-8276-4498-bfa8-84f1c5088edb 0 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14f84b640 1 Processor -- start 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14f84b640 1 -- start start 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14f84b640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fe148124460 0x7fe148124830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14f84b640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe148188af0 con 0x7fe148120000 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14f84b640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe148189cd0 con 0x7fe14811f470 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14f84b640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe14818aeb0 con 0x7fe148124460 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14d5c0640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fe148124460 0x7fe148124830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14cdbf640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7fe14811f470 0x7fe14811f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.120:49834/0 (socket says 10.20.193.120:49834) 2026-02-24T17:24:54.683 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14cdbf640 1 -- 10.20.193.120:0/484697722 learned_addr learned my addr 10.20.193.120:0/484697722 (peer_addr_for_me v1:10.20.193.120:0/0) 2026-02-24T17:24:54.684 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe137fff640 1 -- 10.20.193.120:0/484697722 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249772378 0 0) 0x7fe148189cd0 con 0x7fe14811f470 2026-02-24T17:24:54.684 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe137fff640 1 -- 10.20.193.120:0/484697722 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe130003620 con 0x7fe14811f470 2026-02-24T17:24:54.684 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14d5c0640 1 -- 10.20.193.120:0/484697722 >> v1:10.20.193.109:6789/0 conn(0x7fe14811f470 legacy=0x7fe14811f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.684 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14d5c0640 1 -- 10.20.193.120:0/484697722 >> v1:10.20.193.40:6789/0 conn(0x7fe148120000 legacy=0x7fe148187340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.684 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.677+0000 7fe14d5c0640 1 -- 10.20.193.120:0/484697722 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14818b080 con 0x7fe148124460 2026-02-24T17:24:54.688 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14d5c0640 1 --2- 10.20.193.120:0/484697722 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 0x7fe148124830 secure :-1 s=READY pgs=26 gs=3 cs=0 l=1 c_cookie=67259823714617380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe138004780 tx=0x7fe13801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef4740c2a4824 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:54.688 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe137fff640 1 -- 10.20.193.120:0/484697722 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1380ab680 con 0x7fe148124460 2026-02-24T17:24:54.688 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe137fff640 1 -- 10.20.193.120:0/484697722 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1380b0070 con 0x7fe148124460 2026-02-24T17:24:54.688 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe137fff640 1 -- 10.20.193.120:0/484697722 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1380aba60 con 0x7fe148124460 2026-02-24T17:24:54.688 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- 10.20.193.120:0/484697722 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 msgr2=0x7fe148124830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.688 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 --2- 10.20.193.120:0/484697722 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 0x7fe148124830 secure :-1 s=READY pgs=26 gs=3 cs=0 l=1 c_cookie=67259823714617380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe138004780 tx=0x7fe13801c440 comp rx=0 tx=0).stop 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- 10.20.193.120:0/484697722 shutdown_connections 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 --2- 10.20.193.120:0/484697722 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 0x7fe148124830 unknown :-1 s=CLOSED pgs=26 gs=3 cs=0 l=1 c_cookie=67259823714617380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- 10.20.193.120:0/484697722 >> 10.20.193.120:0/484697722 conn(0x7fe148058430 msgr2=0x7fe148058830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- 10.20.193.120:0/484697722 shutdown_connections 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- 10.20.193.120:0/484697722 wait complete. 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 librados: starting msgr at 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 librados: starting objecter 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 Processor -- start 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- start start 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 librados: setting wanted keys 2026-02-24T17:24:54.689 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 librados: calling monclient init 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe14811f470 0x7fe1481070b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe148120000 0x7fe148107720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 0x7fe14810c8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481898e0 con 0x7fe148124460 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe148189760 con 0x7fe148120000 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fe148189a60 con 0x7fe14811f470 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14d5c0640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe14811f470 0x7fe1481070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14ddc1640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 0x7fe14810c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14d5c0640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe14811f470 0x7fe1481070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:37944/0 (socket says 10.20.193.120:37944) 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14d5c0640 1 -- 10.20.193.120:0/139433576 learned_addr learned my addr 10.20.193.120:0/139433576 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14cdbf640 1 --2- 10.20.193.120:0/139433576 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe148120000 0x7fe148107720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.690 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14ddc1640 1 -- 10.20.193.120:0/139433576 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe14811f470 msgr2=0x7fe1481070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14ddc1640 1 --2- 10.20.193.120:0/139433576 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe14811f470 0x7fe1481070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14ddc1640 1 -- 10.20.193.120:0/139433576 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe148120000 msgr2=0x7fe148107720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14ddc1640 1 --2- 10.20.193.120:0/139433576 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe148120000 0x7fe148107720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14ddc1640 1 -- 10.20.193.120:0/139433576 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14810d1b0 con 0x7fe148124460 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14ddc1640 1 --2- 10.20.193.120:0/139433576 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 0x7fe14810c8f0 secure :-1 s=READY pgs=27 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe144003c80 tx=0x7fe14400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 10 client.?.objecter ms_handle_connect 0x7fe148124460 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 1 -- 10.20.193.120:0/139433576 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe144017020 con 0x7fe148124460 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 1 -- 10.20.193.120:0/139433576 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14400ba70 con 0x7fe148124460 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 1 -- 10.20.193.120:0/139433576 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe14400be40 con 0x7fe148124460 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14810d4a0 con 0x7fe148124460 2026-02-24T17:24:54.691 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 10 client.4125.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe148186560 con 0x7fe148124460 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 librados: init done 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 1 -- 10.20.193.120:0/139433576 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fe144013830 con 0x7fe148124460 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 1 -- 10.20.193.120:0/139433576 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (secure 0 0 0) 0x7fe14401b3b0 con 0x7fe148124460 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 10 client.4125.objecter ms_dispatch2 0x7fe148000ba0 osd_map(2..2 src has 1..2) 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 3 client.4125.objecter handle_osd_map got epochs [2,2] > 0 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 3 client.4125.objecter handle_osd_map decoding full epoch 2 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe135ffb640 20 client.4125.objecter dump_active .. 0 homeless 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.681+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe148189c60 con 0x7fe148124460 2026-02-24T17:24:54.692 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.685+0000 7fe135ffb640 1 -- 10.20.193.120:0/139433576 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7fe144021020 con 0x7fe148124460 2026-02-24T17:24:54.721 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a63c8bf5-8276-4498-bfa8-84f1c5088edb", "id": 0} v 0) -- 0x7fe148057410 con 0x7fe148124460 2026-02-24T17:24:54.722 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe135ffb640 1 -- 10.20.193.120:0/139433576 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a63c8bf5-8276-4498-bfa8-84f1c5088edb", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe14401c400 con 0x7fe148124460 2026-02-24T17:24:54.722 INFO:teuthology.orchestra.run.trial120.stdout:0 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 10 librados: watch_flush enter 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 10 librados: watch_flush exit 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 20 client.4125.objecter shutdown clearing up homeless session... 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 10 client.4125.objecter successfully canceled tick 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 msgr2=0x7fe14810c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 --2- 10.20.193.120:0/139433576 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 0x7fe14810c8f0 secure :-1 s=READY pgs=27 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe144003c80 tx=0x7fe14400dd40 comp rx=0 tx=0).stop 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 shutdown_connections 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 --2- 10.20.193.120:0/139433576 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe148124460 0x7fe14810c8f0 unknown :-1 s=CLOSED pgs=27 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 --2- 10.20.193.120:0/139433576 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe148120000 0x7fe148107720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 --2- 10.20.193.120:0/139433576 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe14811f470 0x7fe1481070b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 >> 10.20.193.120:0/139433576 conn(0x7fe148058430 msgr2=0x7fe1481014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 shutdown_connections 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 -- 10.20.193.120:0/139433576 wait complete. 2026-02-24T17:24:54.723 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.717+0000 7fe14f84b640 1 librados: shutdown 2026-02-24T17:24:54.731 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new 8145c280-0f0a-4c92-8026-76099c124e29 1 2026-02-24T17:24:54.789 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd36613b640 1 Processor -- start 2026-02-24T17:24:54.789 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd36613b640 1 -- start start 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd36613b640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fd360124290 0x7fd360124660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd36613b640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fd36011f260 0x7fd36011f6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd36613b640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd360187880 con 0x7fd36011fc00 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd36613b640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd360188a60 con 0x7fd36011f260 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd36613b640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd360188be0 con 0x7fd360124290 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd365139640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fd360124290 0x7fd360124660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd365139640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fd360124290 0x7fd360124660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50374/0 (socket says 10.20.193.120:50374) 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd365139640 1 -- 10.20.193.120:0/1001791289 learned_addr learned my addr 10.20.193.120:0/1001791289 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd364938640 1 --2- 10.20.193.120:0/1001791289 >> v2:10.20.193.40:3300/0 conn(0x7fd36011f260 0x7fd36011f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd36593a640 1 --1- 10.20.193.120:0/1001791289 >> v1:10.20.193.109:6789/0 conn(0x7fd36011fc00 0x7fd360186160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.120:49846/0 (socket says 10.20.193.120:49846) 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd365139640 1 -- 10.20.193.120:0/1001791289 >> v2:10.20.193.40:3300/0 conn(0x7fd36011f260 msgr2=0x7fd36011f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:54.790 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd365139640 1 --2- 10.20.193.120:0/1001791289 >> v2:10.20.193.40:3300/0 conn(0x7fd36011f260 0x7fd36011f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.791 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd365139640 1 -- 10.20.193.120:0/1001791289 >> v1:10.20.193.109:6789/0 conn(0x7fd36011fc00 legacy=0x7fd360186160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.791 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.785+0000 7fd365139640 1 -- 10.20.193.120:0/1001791289 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd360188d60 con 0x7fd360124290 2026-02-24T17:24:54.791 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd365139640 1 --2- 10.20.193.120:0/1001791289 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd360124660 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=2747670636137441634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3600592b0 tx=0x7fd35001c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2621afe2c2be6962 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:54.791 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34ffff640 1 -- 10.20.193.120:0/1001791289 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3500aa680 con 0x7fd360124290 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34ffff640 1 -- 10.20.193.120:0/1001791289 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3500af070 con 0x7fd360124290 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34ffff640 1 -- 10.20.193.120:0/1001791289 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3500aaa60 con 0x7fd360124290 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- 10.20.193.120:0/1001791289 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 msgr2=0x7fd360124660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 --2- 10.20.193.120:0/1001791289 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd360124660 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=2747670636137441634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3600592b0 tx=0x7fd35001c4e0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- 10.20.193.120:0/1001791289 shutdown_connections 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 --2- 10.20.193.120:0/1001791289 >> v2:10.20.193.40:3300/0 conn(0x7fd36011f260 0x7fd36011f6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 --2- 10.20.193.120:0/1001791289 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd360124660 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=2747670636137441634 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- 10.20.193.120:0/1001791289 >> 10.20.193.120:0/1001791289 conn(0x7fd360057e00 msgr2=0x7fd360058200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- 10.20.193.120:0/1001791289 shutdown_connections 2026-02-24T17:24:54.792 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- 10.20.193.120:0/1001791289 wait complete. 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 librados: starting msgr at 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 librados: starting objecter 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 Processor -- start 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- start start 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 librados: setting wanted keys 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 librados: calling monclient init 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd36011f260 0x7fd360108070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd36011fc00 0x7fd3601086e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd36010d820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd360188630 con 0x7fd36011fc00 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd3601884b0 con 0x7fd360124290 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fd3601887b0 con 0x7fd36011f260 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd36010d820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd36010d820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50388/0 (socket says 10.20.193.120:50388) 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd365139640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd36011f260 0x7fd360108070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 -- 10.20.193.120:0/2546511896 learned_addr learned my addr 10.20.193.120:0/2546511896 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:54.793 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd364938640 1 --2- 10.20.193.120:0/2546511896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd36011fc00 0x7fd3601086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 -- 10.20.193.120:0/2546511896 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd36011f260 msgr2=0x7fd360108070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 --2- 10.20.193.120:0/2546511896 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd36011f260 0x7fd360108070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 -- 10.20.193.120:0/2546511896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd36011fc00 msgr2=0x7fd3601086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 --2- 10.20.193.120:0/2546511896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd36011fc00 0x7fd3601086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 -- 10.20.193.120:0/2546511896 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36010e0e0 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36593a640 1 --2- 10.20.193.120:0/2546511896 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd36010d820 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd35c00dbb0 tx=0x7fd35c00b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 10 client.?.objecter ms_handle_connect 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 1 -- 10.20.193.120:0/2546511896 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd35c018070 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36010e3d0 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 1 -- 10.20.193.120:0/2546511896 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c00bd60 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 1 -- 10.20.193.120:0/2546511896 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd35c013620 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 10 client.4126.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3601862c0 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 librados: init done 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 1 -- 10.20.193.120:0/2546511896 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fd35c01c7c0 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd36011f6c0 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 1 -- 10.20.193.120:0/2546511896 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (secure 0 0 0) 0x7fd35c01b710 con 0x7fd360124290 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 10 client.4126.objecter ms_dispatch2 0x7fd360000ba0 osd_map(3..3 src has 1..3) 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 3 client.4126.objecter handle_osd_map got epochs [3,3] > 0 2026-02-24T17:24:54.794 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 3 client.4126.objecter handle_osd_map decoding full epoch 3 2026-02-24T17:24:54.795 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.789+0000 7fd34dffb640 20 client.4126.objecter dump_active .. 0 homeless 2026-02-24T17:24:54.796 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.793+0000 7fd34dffb640 1 -- 10.20.193.120:0/2546511896 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7fd35c006e20 con 0x7fd360124290 2026-02-24T17:24:54.829 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.825+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8145c280-0f0a-4c92-8026-76099c124e29", "id": 1} v 0) -- 0x7fd360057410 con 0x7fd360124290 2026-02-24T17:24:54.831 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd34dffb640 1 -- 10.20.193.120:0/2546511896 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8145c280-0f0a-4c92-8026-76099c124e29", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd35c01cd40 con 0x7fd360124290 2026-02-24T17:24:54.831 INFO:teuthology.orchestra.run.trial120.stdout:1 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 10 librados: watch_flush enter 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 10 librados: watch_flush exit 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 20 client.4126.objecter shutdown clearing up homeless session... 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 10 client.4126.objecter successfully canceled tick 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 msgr2=0x7fd36010d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 --2- 10.20.193.120:0/2546511896 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd36010d820 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd35c00dbb0 tx=0x7fd35c00b430 comp rx=0 tx=0).stop 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 shutdown_connections 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 --2- 10.20.193.120:0/2546511896 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd360124290 0x7fd36010d820 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 --2- 10.20.193.120:0/2546511896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd36011fc00 0x7fd3601086e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 --2- 10.20.193.120:0/2546511896 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd36011f260 0x7fd360108070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 >> 10.20.193.120:0/2546511896 conn(0x7fd360057e00 msgr2=0x7fd3600fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 shutdown_connections 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 -- 10.20.193.120:0/2546511896 wait complete. 2026-02-24T17:24:54.832 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.829+0000 7fd36613b640 1 librados: shutdown 2026-02-24T17:24:54.840 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new c2f26f49-f93a-43e9-b17b-871ec271af4d 2 2026-02-24T17:24:54.902 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072bb70640 1 Processor -- start 2026-02-24T17:24:54.902 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072bb70640 1 -- start start 2026-02-24T17:24:54.902 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072bb70640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f0724165ba0 0x7f0724186050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.902 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072bb70640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0724186770 con 0x7f0724122190 2026-02-24T17:24:54.902 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072bb70640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0724187990 con 0x7f0724144040 2026-02-24T17:24:54.902 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072bb70640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f0724188b90 con 0x7f0724165ba0 2026-02-24T17:24:54.902 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f07298e5640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f0724122190 0x7f0724122560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.120:51530/0 (socket says 10.20.193.120:51530) 2026-02-24T17:24:54.902 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f07298e5640 1 -- 10.20.193.120:0/321263177 learned_addr learned my addr 10.20.193.120:0/321263177 (peer_addr_for_me v1:10.20.193.120:0/0) 2026-02-24T17:24:54.903 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072a0e6640 1 --2- 10.20.193.120:0/321263177 >> v2:10.20.193.94:3300/0 conn(0x7f0724165ba0 0x7f0724186050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.903 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f07288e3640 1 -- 10.20.193.120:0/321263177 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851324205 0 0) 0x7f0724186770 con 0x7f0724122190 2026-02-24T17:24:54.903 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f07288e3640 1 -- 10.20.193.120:0/321263177 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f070c003620 con 0x7f0724122190 2026-02-24T17:24:54.903 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072a0e6640 1 -- 10.20.193.120:0/321263177 >> v1:10.20.193.109:6789/0 conn(0x7f0724144040 legacy=0x7f0724164420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.903 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072a0e6640 1 -- 10.20.193.120:0/321263177 >> v1:10.20.193.40:6789/0 conn(0x7f0724122190 legacy=0x7f0724122560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.903 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072a0e6640 1 -- 10.20.193.120:0/321263177 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0724188d60 con 0x7f0724165ba0 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f072a0e6640 1 --2- 10.20.193.120:0/321263177 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724165ba0 0x7f0724186050 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=4267558223460044284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0720005c90 tx=0x7f072001d7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b396997ffa20dfc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f07288e3640 1 -- 10.20.193.120:0/321263177 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07200b3070 con 0x7f0724165ba0 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f07288e3640 1 -- 10.20.193.120:0/321263177 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07200a68e0 con 0x7f0724165ba0 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.897+0000 7f07288e3640 1 -- 10.20.193.120:0/321263177 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07200a6cf0 con 0x7f0724165ba0 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- 10.20.193.120:0/321263177 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724165ba0 msgr2=0x7f0724186050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 --2- 10.20.193.120:0/321263177 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724165ba0 0x7f0724186050 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=4267558223460044284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0720005c90 tx=0x7f072001d7d0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- 10.20.193.120:0/321263177 shutdown_connections 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 --2- 10.20.193.120:0/321263177 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724165ba0 0x7f0724186050 unknown :-1 s=CLOSED pgs=19 gs=3 cs=0 l=1 c_cookie=4267558223460044284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- 10.20.193.120:0/321263177 >> 10.20.193.120:0/321263177 conn(0x7f072405b7e0 msgr2=0x7f072405bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:54.907 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- 10.20.193.120:0/321263177 shutdown_connections 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- 10.20.193.120:0/321263177 wait complete. 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 librados: starting msgr at 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 librados: starting objecter 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 Processor -- start 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- start start 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 librados: setting wanted keys 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 librados: calling monclient init 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0724122190 0x7f0724185f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724144040 0x7f072412d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0724165ba0 0x7f072412dbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:54.908 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0724188840 con 0x7f0724165ba0 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f07241886c0 con 0x7f0724144040 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f07241889c0 con 0x7f0724122190 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07290e4640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724144040 0x7f072412d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07298e5640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0724122190 0x7f0724185f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07298e5640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0724122190 0x7f0724185f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:37968/0 (socket says 10.20.193.120:37968) 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07290e4640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724144040 0x7f072412d440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50410/0 (socket says 10.20.193.120:50410) 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07298e5640 1 -- 10.20.193.120:0/3363039042 learned_addr learned my addr 10.20.193.120:0/3363039042 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072a0e6640 1 --2- 10.20.193.120:0/3363039042 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0724165ba0 0x7f072412dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07290e4640 1 -- 10.20.193.120:0/3363039042 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0724122190 msgr2=0x7f0724185f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07290e4640 1 --2- 10.20.193.120:0/3363039042 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0724122190 0x7f0724185f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.909 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07290e4640 1 -- 10.20.193.120:0/3363039042 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0724165ba0 msgr2=0x7f072412dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07290e4640 1 --2- 10.20.193.120:0/3363039042 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0724165ba0 0x7f072412dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07290e4640 1 -- 10.20.193.120:0/3363039042 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0724132f40 con 0x7f0724144040 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07290e4640 1 --2- 10.20.193.120:0/3363039042 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724144040 0x7f072412d440 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0718002770 tx=0x7f071800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 10 client.?.objecter ms_handle_connect 0x7f0724144040 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 1 -- 10.20.193.120:0/3363039042 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0718017070 con 0x7f0724144040 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0724133230 con 0x7f0724144040 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0724133840 con 0x7f0724144040 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 librados: init done 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 1 -- 10.20.193.120:0/3363039042 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0718006af0 con 0x7f0724144040 2026-02-24T17:24:54.910 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 1 -- 10.20.193.120:0/3363039042 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0718007030 con 0x7f0724144040 2026-02-24T17:24:54.911 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 1 -- 10.20.193.120:0/3363039042 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f07180075e0 con 0x7f0724144040 2026-02-24T17:24:54.911 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 1 -- 10.20.193.120:0/3363039042 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (secure 0 0 0) 0x7f0718011a20 con 0x7f0724144040 2026-02-24T17:24:54.911 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 10 client.4132.objecter ms_dispatch2 0x7f0724000ba0 osd_map(4..4 src has 1..4) 2026-02-24T17:24:54.911 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 3 client.4132.objecter handle_osd_map got epochs [4,4] > 0 2026-02-24T17:24:54.911 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 3 client.4132.objecter handle_osd_map decoding full epoch 4 2026-02-24T17:24:54.911 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f07127fc640 20 client.4132.objecter dump_active .. 0 homeless 2026-02-24T17:24:54.911 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.901+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07241225e0 con 0x7f0724144040 2026-02-24T17:24:54.912 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.905+0000 7f07127fc640 1 -- 10.20.193.120:0/3363039042 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f0718011c60 con 0x7f0724144040 2026-02-24T17:24:54.941 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c2f26f49-f93a-43e9-b17b-871ec271af4d", "id": 2} v 0) -- 0x7f072405a810 con 0x7f0724144040 2026-02-24T17:24:54.943 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f07127fc640 1 -- 10.20.193.120:0/3363039042 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c2f26f49-f93a-43e9-b17b-871ec271af4d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f0718011600 con 0x7f0724144040 2026-02-24T17:24:54.943 INFO:teuthology.orchestra.run.trial120.stdout:2 2026-02-24T17:24:54.946 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 10 librados: watch_flush enter 2026-02-24T17:24:54.946 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 10 librados: watch_flush exit 2026-02-24T17:24:54.946 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 20 client.4132.objecter shutdown clearing up homeless session... 2026-02-24T17:24:54.947 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 10 client.4132.objecter successfully canceled tick 2026-02-24T17:24:54.947 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724144040 msgr2=0x7f072412d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:54.947 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 --2- 10.20.193.120:0/3363039042 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724144040 0x7f072412d440 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0718002770 tx=0x7f071800c960 comp rx=0 tx=0).stop 2026-02-24T17:24:54.947 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 shutdown_connections 2026-02-24T17:24:54.947 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 --2- 10.20.193.120:0/3363039042 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0724165ba0 0x7f072412dbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.947 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 --2- 10.20.193.120:0/3363039042 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0724144040 0x7f072412d440 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.948 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 --2- 10.20.193.120:0/3363039042 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0724122190 0x7f0724185f80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:54.948 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 >> 10.20.193.120:0/3363039042 conn(0x7f072405b7e0 msgr2=0x7f07240589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:54.948 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 shutdown_connections 2026-02-24T17:24:54.948 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 -- 10.20.193.120:0/3363039042 wait complete. 2026-02-24T17:24:54.948 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:54.937+0000 7f072bb70640 1 librados: shutdown 2026-02-24T17:24:54.953 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new 29f34fbd-eed3-4f11-8368-c83f4c080816 3 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.005+0000 7f6cd4e88640 1 Processor -- start 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.005+0000 7f6cd4e88640 1 -- start start 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.005+0000 7f6cd4e88640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f6cd0122030 0x7f6cd0122400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.005+0000 7f6cd4e88640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f6cd005e690 0x7f6cd0184f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.005+0000 7f6cd4e88640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd0185450 con 0x7f6cd005db20 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.005+0000 7f6cd4e88640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd0186670 con 0x7f6cd0122030 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.005+0000 7f6cd4e88640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd01867f0 con 0x7f6cd005e690 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccffff640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f6cd005e690 0x7f6cd0184f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.013 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cceffd640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7f6cd005db20 0x7f6cd005df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.120:49864/0 (socket says 10.20.193.120:49864) 2026-02-24T17:24:55.014 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cceffd640 1 -- 10.20.193.120:0/2773715185 learned_addr learned my addr 10.20.193.120:0/2773715185 (peer_addr_for_me v1:10.20.193.120:0/0) 2026-02-24T17:24:55.014 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 --2- 10.20.193.120:0/2773715185 >> v2:10.20.193.94:3300/0 conn(0x7f6cd0122030 0x7f6cd0122400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.014 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cce7fc640 1 -- 10.20.193.120:0/2773715185 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1774160766 0 0) 0x7f6cd0185450 con 0x7f6cd005db20 2026-02-24T17:24:55.014 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cce7fc640 1 -- 10.20.193.120:0/2773715185 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cb4003620 con 0x7f6cd005db20 2026-02-24T17:24:55.014 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccffff640 1 -- 10.20.193.120:0/2773715185 >> v2:10.20.193.94:3300/0 conn(0x7f6cd0122030 msgr2=0x7f6cd0122400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.014 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccffff640 1 --2- 10.20.193.120:0/2773715185 >> v2:10.20.193.94:3300/0 conn(0x7f6cd0122030 0x7f6cd0122400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.014 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccffff640 1 -- 10.20.193.120:0/2773715185 >> v1:10.20.193.109:6789/0 conn(0x7f6cd005db20 legacy=0x7f6cd005df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.014 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccffff640 1 -- 10.20.193.120:0/2773715185 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd01869a0 con 0x7f6cd005e690 2026-02-24T17:24:55.018 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccffff640 1 --2- 10.20.193.120:0/2773715185 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd005e690 0x7f6cd0184f10 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=10862702910033054910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd0122af0 tx=0x7f6cc401d840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96c012be5d1f4cbe server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.018 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cce7fc640 1 -- 10.20.193.120:0/2773715185 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cc40b3070 con 0x7f6cd005e690 2026-02-24T17:24:55.018 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cce7fc640 1 -- 10.20.193.120:0/2773715185 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc40a6950 con 0x7f6cd005e690 2026-02-24T17:24:55.018 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cce7fc640 1 -- 10.20.193.120:0/2773715185 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cc40a6d60 con 0x7f6cd005e690 2026-02-24T17:24:55.018 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- 10.20.193.120:0/2773715185 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd005e690 msgr2=0x7f6cd0184f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 --2- 10.20.193.120:0/2773715185 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd005e690 0x7f6cd0184f10 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=10862702910033054910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cd0122af0 tx=0x7f6cc401d840 comp rx=0 tx=0).stop 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- 10.20.193.120:0/2773715185 shutdown_connections 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 --2- 10.20.193.120:0/2773715185 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd005e690 0x7f6cd0184f10 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=10862702910033054910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 --2- 10.20.193.120:0/2773715185 >> v2:10.20.193.94:3300/0 conn(0x7f6cd0122030 0x7f6cd0122400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- 10.20.193.120:0/2773715185 >> 10.20.193.120:0/2773715185 conn(0x7f6cd005b5f0 msgr2=0x7f6cd005b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- 10.20.193.120:0/2773715185 shutdown_connections 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- 10.20.193.120:0/2773715185 wait complete. 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 librados: starting msgr at 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 librados: starting objecter 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 Processor -- start 2026-02-24T17:24:55.019 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- start start 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 librados: setting wanted keys 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 librados: calling monclient init 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6cd005db20 0x7f6cd01092e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6cd005e690 0x7f6cd0109950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd0122030 0x7f6cd010eb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd01862e0 con 0x7f6cd005db20 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0186160 con 0x7f6cd005e690 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0186460 con 0x7f6cd0122030 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6cd005db20 0x7f6cd01092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6cd005db20 0x7f6cd01092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39496/0 (socket says 10.20.193.120:39496) 2026-02-24T17:24:55.020 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 -- 10.20.193.120:0/3760809114 learned_addr learned my addr 10.20.193.120:0/3760809114 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccffff640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd0122030 0x7f6cd010eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cceffd640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6cd005e690 0x7f6cd0109950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 -- 10.20.193.120:0/3760809114 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd0122030 msgr2=0x7f6cd010eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd0122030 0x7f6cd010eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 -- 10.20.193.120:0/3760809114 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6cd005e690 msgr2=0x7f6cd0109950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6cd005e690 0x7f6cd0109950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 -- 10.20.193.120:0/3760809114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd010f3e0 con 0x7f6cd005db20 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6ccf7fe640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6cd005db20 0x7f6cd01092e0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cbc009430 tx=0x7f6cbc00ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cabfff640 10 client.?.objecter ms_handle_connect 0x7f6cd005db20 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cabfff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cabfff640 1 -- 10.20.193.120:0/3760809114 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cbc017070 con 0x7f6cd005db20 2026-02-24T17:24:55.021 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cabfff640 1 -- 10.20.193.120:0/3760809114 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cbc00cb60 con 0x7f6cd005db20 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd010f6d0 con 0x7f6cd005db20 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cabfff640 1 -- 10.20.193.120:0/3760809114 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cbc013470 con 0x7f6cd005db20 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 10 client.4140.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01840e0 con 0x7f6cd005db20 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cd4e88640 1 librados: init done 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cabfff640 1 -- 10.20.193.120:0/3760809114 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f6cbc013a20 con 0x7f6cd005db20 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.009+0000 7f6cabfff640 1 -- 10.20.193.120:0/3760809114 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (secure 0 0 0) 0x7f6cbc00f040 con 0x7f6cd005db20 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.013+0000 7f6cabfff640 10 client.4140.objecter ms_dispatch2 0x7f6cd0000ba0 osd_map(5..5 src has 1..5) 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.013+0000 7f6cabfff640 3 client.4140.objecter handle_osd_map got epochs [5,5] > 0 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.013+0000 7f6cabfff640 3 client.4140.objecter handle_osd_map decoding full epoch 5 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.013+0000 7f6cabfff640 20 client.4140.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.022 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.013+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd005a810 con 0x7f6cd005db20 2026-02-24T17:24:55.023 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.013+0000 7f6cabfff640 1 -- 10.20.193.120:0/3760809114 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f6cbc013d40 con 0x7f6cd005db20 2026-02-24T17:24:55.051 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "29f34fbd-eed3-4f11-8368-c83f4c080816", "id": 3} v 0) -- 0x7f6cd01843a0 con 0x7f6cd005db20 2026-02-24T17:24:55.052 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cabfff640 1 -- 10.20.193.120:0/3760809114 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29f34fbd-eed3-4f11-8368-c83f4c080816", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6cbc0123d0 con 0x7f6cd005db20 2026-02-24T17:24:55.053 INFO:teuthology.orchestra.run.trial120.stdout:3 2026-02-24T17:24:55.054 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 10 librados: watch_flush enter 2026-02-24T17:24:55.054 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 10 librados: watch_flush exit 2026-02-24T17:24:55.054 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 20 client.4140.objecter shutdown clearing up homeless session... 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 10 client.4140.objecter successfully canceled tick 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6cd005db20 msgr2=0x7f6cd01092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6cd005db20 0x7f6cd01092e0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cbc009430 tx=0x7f6cbc00ee10 comp rx=0 tx=0).stop 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 shutdown_connections 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6cd0122030 0x7f6cd010eb20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6cd005e690 0x7f6cd0109950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 --2- 10.20.193.120:0/3760809114 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6cd005db20 0x7f6cd01092e0 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 >> 10.20.193.120:0/3760809114 conn(0x7f6cd005b5f0 msgr2=0x7f6cd0122d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 shutdown_connections 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 -- 10.20.193.120:0/3760809114 wait complete. 2026-02-24T17:24:55.055 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.049+0000 7f6cd4e88640 1 librados: shutdown 2026-02-24T17:24:55.061 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new 50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec 4 2026-02-24T17:24:55.122 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff878b55640 1 Processor -- start 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff878b55640 1 -- start start 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff878b55640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7ff874124460 0x7ff874124830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff878b55640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7ff87411f470 0x7ff87411f8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff878b55640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7ff87411fe30 0x7ff874186330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff878b55640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff874186870 con 0x7ff874124460 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff878b55640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff8741869f0 con 0x7ff87411f470 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff878b55640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7ff874186b70 con 0x7ff87411fe30 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7ff87411fe30 0x7ff874186330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff871d74640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7ff87411f470 0x7ff87411f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.123 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872575640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7ff874124460 0x7ff874124830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.124 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7ff87411fe30 0x7ff874186330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:38002/0 (socket says 10.20.193.120:38002) 2026-02-24T17:24:55.124 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 -- 10.20.193.120:0/4286771408 learned_addr learned my addr 10.20.193.120:0/4286771408 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.124 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 -- 10.20.193.120:0/4286771408 >> v2:10.20.193.94:3300/0 conn(0x7ff87411f470 msgr2=0x7ff87411f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.124 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 --2- 10.20.193.120:0/4286771408 >> v2:10.20.193.94:3300/0 conn(0x7ff87411f470 0x7ff87411f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.124 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 -- 10.20.193.120:0/4286771408 >> v2:10.20.193.40:3300/0 conn(0x7ff874124460 msgr2=0x7ff874124830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.124 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 --2- 10.20.193.120:0/4286771408 >> v2:10.20.193.40:3300/0 conn(0x7ff874124460 0x7ff874124830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.124 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 -- 10.20.193.120:0/4286771408 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff874186cf0 con 0x7ff87411fe30 2026-02-24T17:24:55.124 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff871d74640 1 --2- 10.20.193.120:0/4286771408 >> v2:10.20.193.94:3300/0 conn(0x7ff87411f470 0x7ff87411f8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff872d76640 1 --2- 10.20.193.120:0/4286771408 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411fe30 0x7ff874186330 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=16667716932392683950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff874124e20 tx=0x7ff86401d830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74fa03d9c0789ae server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff871573640 1 -- 10.20.193.120:0/4286771408 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8640b3070 con 0x7ff87411fe30 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff871573640 1 -- 10.20.193.120:0/4286771408 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8640a6830 con 0x7ff87411fe30 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.117+0000 7ff871573640 1 -- 10.20.193.120:0/4286771408 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8640a6c40 con 0x7ff87411fe30 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- 10.20.193.120:0/4286771408 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411fe30 msgr2=0x7ff874186330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 --2- 10.20.193.120:0/4286771408 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411fe30 0x7ff874186330 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=16667716932392683950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff874124e20 tx=0x7ff86401d830 comp rx=0 tx=0).stop 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- 10.20.193.120:0/4286771408 shutdown_connections 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 --2- 10.20.193.120:0/4286771408 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411fe30 0x7ff874186330 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=16667716932392683950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 --2- 10.20.193.120:0/4286771408 >> v2:10.20.193.94:3300/0 conn(0x7ff87411f470 0x7ff87411f8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.129 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 --2- 10.20.193.120:0/4286771408 >> v2:10.20.193.40:3300/0 conn(0x7ff874124460 0x7ff874124830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- 10.20.193.120:0/4286771408 >> 10.20.193.120:0/4286771408 conn(0x7ff874058430 msgr2=0x7ff874058830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- 10.20.193.120:0/4286771408 shutdown_connections 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- 10.20.193.120:0/4286771408 wait complete. 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 librados: starting msgr at 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 librados: starting objecter 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 Processor -- start 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- start start 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 librados: setting wanted keys 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 librados: calling monclient init 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411f470 0x7ff874108140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.130 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff87411fe30 0x7ff874186310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff874124460 0x7ff874108990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff874189e20 con 0x7ff87411fe30 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff874189ca0 con 0x7ff874124460 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff874189fa0 con 0x7ff87411f470 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff87411fe30 0x7ff874186310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff87411fe30 0x7ff874186310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39526/0 (socket says 10.20.193.120:39526) 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 -- 10.20.193.120:0/1399043231 learned_addr learned my addr 10.20.193.120:0/1399043231 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff872d76640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff874124460 0x7ff874108990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff872575640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411f470 0x7ff874108140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 -- 10.20.193.120:0/1399043231 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411f470 msgr2=0x7ff874108140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411f470 0x7ff874108140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.131 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 -- 10.20.193.120:0/1399043231 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff874124460 msgr2=0x7ff874108990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff874124460 0x7ff874108990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 -- 10.20.193.120:0/1399043231 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87410dce0 con 0x7ff87411fe30 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff871d74640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff87411fe30 0x7ff874186310 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff85c00ebb0 tx=0x7ff85c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 10 client.?.objecter ms_handle_connect 0x7ff87411fe30 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 1 -- 10.20.193.120:0/1399043231 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff85c017070 con 0x7ff87411fe30 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87410dfd0 con 0x7ff87411fe30 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 10 client.4146.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87410e530 con 0x7ff87411fe30 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 librados: init done 2026-02-24T17:24:55.132 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 1 -- 10.20.193.120:0/1399043231 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85c00ce50 con 0x7ff87411fe30 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 1 -- 10.20.193.120:0/1399043231 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff85c021060 con 0x7ff87411fe30 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 1 -- 10.20.193.120:0/1399043231 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7ff85c004430 con 0x7ff87411fe30 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 1 -- 10.20.193.120:0/1399043231 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (secure 0 0 0) 0x7ff85c00f040 con 0x7ff87411fe30 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 10 client.4146.objecter ms_dispatch2 0x7ff874000ba0 osd_map(6..6 src has 1..6) 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 3 client.4146.objecter handle_osd_map got epochs [6,6] > 0 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 3 client.4146.objecter handle_osd_map decoding full epoch 6 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 20 client.4146.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff874124830 con 0x7ff87411fe30 2026-02-24T17:24:55.133 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.121+0000 7ff85affd640 1 -- 10.20.193.120:0/1399043231 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7ff85c013e20 con 0x7ff87411fe30 2026-02-24T17:24:55.160 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec", "id": 4} v 0) -- 0x7ff874057410 con 0x7ff87411fe30 2026-02-24T17:24:55.161 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff85affd640 1 -- 10.20.193.120:0/1399043231 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff85c013470 con 0x7ff87411fe30 2026-02-24T17:24:55.161 INFO:teuthology.orchestra.run.trial120.stdout:4 2026-02-24T17:24:55.162 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 10 librados: watch_flush enter 2026-02-24T17:24:55.163 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 10 librados: watch_flush exit 2026-02-24T17:24:55.163 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 20 client.4146.objecter shutdown clearing up homeless session... 2026-02-24T17:24:55.163 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 10 client.4146.objecter successfully canceled tick 2026-02-24T17:24:55.163 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff87411fe30 msgr2=0x7ff874186310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.163 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff87411fe30 0x7ff874186310 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff85c00ebb0 tx=0x7ff85c00c520 comp rx=0 tx=0).stop 2026-02-24T17:24:55.163 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 shutdown_connections 2026-02-24T17:24:55.164 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff874124460 0x7ff874108990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.164 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff87411fe30 0x7ff874186310 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.164 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 --2- 10.20.193.120:0/1399043231 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff87411f470 0x7ff874108140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.164 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 >> 10.20.193.120:0/1399043231 conn(0x7ff874058430 msgr2=0x7ff8741025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.164 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 shutdown_connections 2026-02-24T17:24:55.164 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 -- 10.20.193.120:0/1399043231 wait complete. 2026-02-24T17:24:55.165 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.157+0000 7ff878b55640 1 librados: shutdown 2026-02-24T17:24:55.170 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new 39b6c845-a7fd-440b-9d84-1969c6236693 5 2026-02-24T17:24:55.227 INFO:tasks.ceph.mgr.x.trial120.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-24T17:24:55.230 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab9932e640 1 Processor -- start 2026-02-24T17:24:55.230 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab9932e640 1 -- start start 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab9932e640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fab94167ed0 0x7fab94188360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab9932e640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab94188a80 con 0x7fab94124460 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab9932e640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab94189ca0 con 0x7fab94146310 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab9932e640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fab9418aea0 con 0x7fab94167ed0 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab937fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fab94167ed0 0x7fab94188360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab92ffd640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7fab94124460 0x7fab94124830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.120:39328/0 (socket says 10.20.193.120:39328) 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab92ffd640 1 -- 10.20.193.120:0/1098809202 learned_addr learned my addr 10.20.193.120:0/1098809202 (peer_addr_for_me v1:10.20.193.120:0/0) 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab927fc640 1 --1- 10.20.193.120:0/1098809202 >> v1:10.20.193.109:6789/0 conn(0x7fab94146310 0x7fab941666f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.120:49870/0 (socket says 10.20.193.120:49870) 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab937fe640 1 -- 10.20.193.120:0/1098809202 >> v1:10.20.193.109:6789/0 conn(0x7fab94146310 legacy=0x7fab941666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.231 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab937fe640 1 -- 10.20.193.120:0/1098809202 >> v1:10.20.193.94:6789/0 conn(0x7fab94124460 legacy=0x7fab94124830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.232 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab937fe640 1 -- 10.20.193.120:0/1098809202 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9418b070 con 0x7fab94167ed0 2026-02-24T17:24:55.239 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab937fe640 1 --2- 10.20.193.120:0/1098809202 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94167ed0 0x7fab94188360 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=5729761431741023565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab84005c90 tx=0x7fab8401d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8433aa22a8454d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.239 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.225+0000 7fab91ffb640 1 -- 10.20.193.120:0/1098809202 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab840b3070 con 0x7fab94167ed0 2026-02-24T17:24:55.239 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab91ffb640 1 -- 10.20.193.120:0/1098809202 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab840a68e0 con 0x7fab94167ed0 2026-02-24T17:24:55.239 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab91ffb640 1 -- 10.20.193.120:0/1098809202 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab840a6cf0 con 0x7fab94167ed0 2026-02-24T17:24:55.239 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- 10.20.193.120:0/1098809202 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94167ed0 msgr2=0x7fab94188360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.240 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 --2- 10.20.193.120:0/1098809202 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94167ed0 0x7fab94188360 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=5729761431741023565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab84005c90 tx=0x7fab8401d7d0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.240 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- 10.20.193.120:0/1098809202 shutdown_connections 2026-02-24T17:24:55.240 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 --2- 10.20.193.120:0/1098809202 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94167ed0 0x7fab94188360 unknown :-1 s=CLOSED pgs=31 gs=3 cs=0 l=1 c_cookie=5729761431741023565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.240 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- 10.20.193.120:0/1098809202 >> 10.20.193.120:0/1098809202 conn(0x7fab94058430 msgr2=0x7fab94058830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.240 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- 10.20.193.120:0/1098809202 shutdown_connections 2026-02-24T17:24:55.241 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- 10.20.193.120:0/1098809202 wait complete. 2026-02-24T17:24:55.241 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 librados: starting msgr at 2026-02-24T17:24:55.241 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 librados: starting objecter 2026-02-24T17:24:55.241 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 Processor -- start 2026-02-24T17:24:55.241 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- start start 2026-02-24T17:24:55.241 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 librados: setting wanted keys 2026-02-24T17:24:55.242 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 librados: calling monclient init 2026-02-24T17:24:55.242 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fab94124460 0x7fab9412e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.242 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94146310 0x7fab9412e9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.242 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fab94167ed0 0x7fab94133ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.242 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fab941898d0 con 0x7fab94146310 2026-02-24T17:24:55.243 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fab94189750 con 0x7fab94124460 2026-02-24T17:24:55.243 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fab94189a50 con 0x7fab94167ed0 2026-02-24T17:24:55.243 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fab94124460 0x7fab9412e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.243 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab937fe640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fab94167ed0 0x7fab94133ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.243 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fab94124460 0x7fab9412e360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50458/0 (socket says 10.20.193.120:50458) 2026-02-24T17:24:55.244 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab927fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94146310 0x7fab9412e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.244 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 -- 10.20.193.120:0/3575426771 learned_addr learned my addr 10.20.193.120:0/3575426771 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.244 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 -- 10.20.193.120:0/3575426771 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fab94167ed0 msgr2=0x7fab94133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.244 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 --2- 10.20.193.120:0/3575426771 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fab94167ed0 0x7fab94133ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.244 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 -- 10.20.193.120:0/3575426771 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94146310 msgr2=0x7fab9412e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.244 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 --2- 10.20.193.120:0/3575426771 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94146310 0x7fab9412e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.245 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 -- 10.20.193.120:0/3575426771 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab94134460 con 0x7fab94124460 2026-02-24T17:24:55.245 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab937fe640 1 --2- 10.20.193.120:0/3575426771 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fab94167ed0 0x7fab94133ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:55.245 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab92ffd640 1 --2- 10.20.193.120:0/3575426771 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fab94124460 0x7fab9412e360 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab8800c700 tx=0x7fab8800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.245 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 10 client.?.objecter ms_handle_connect 0x7fab94124460 2026-02-24T17:24:55.245 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.246 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 1 -- 10.20.193.120:0/3575426771 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab88017070 con 0x7fab94124460 2026-02-24T17:24:55.246 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 1 -- 10.20.193.120:0/3575426771 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab88005bf0 con 0x7fab94124460 2026-02-24T17:24:55.246 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab94134750 con 0x7fab94124460 2026-02-24T17:24:55.246 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 1 -- 10.20.193.120:0/3575426771 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab88007070 con 0x7fab94124460 2026-02-24T17:24:55.246 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 10 client.4150.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.246 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9411e410 con 0x7fab94124460 2026-02-24T17:24:55.247 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 librados: init done 2026-02-24T17:24:55.247 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 1 -- 10.20.193.120:0/3575426771 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fab88007620 con 0x7fab94124460 2026-02-24T17:24:55.247 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 1 -- 10.20.193.120:0/3575426771 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (secure 0 0 0) 0x7fab8801cd20 con 0x7fab94124460 2026-02-24T17:24:55.247 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 10 client.4150.objecter ms_dispatch2 0x7fab94000ba0 osd_map(7..7 src has 1..7) 2026-02-24T17:24:55.247 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 3 client.4150.objecter handle_osd_map got epochs [7,7] > 0 2026-02-24T17:24:55.248 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 3 client.4150.objecter handle_osd_map decoding full epoch 7 2026-02-24T17:24:55.248 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab737fe640 20 client.4150.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.248 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.229+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab941248b0 con 0x7fab94124460 2026-02-24T17:24:55.248 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.233+0000 7fab737fe640 1 -- 10.20.193.120:0/3575426771 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7fab88021070 con 0x7fab94124460 2026-02-24T17:24:55.269 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.265+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39b6c845-a7fd-440b-9d84-1969c6236693", "id": 5} v 0) -- 0x7fab9411e6d0 con 0x7fab94124460 2026-02-24T17:24:55.271 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.265+0000 7fab737fe640 1 -- 10.20.193.120:0/3575426771 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39b6c845-a7fd-440b-9d84-1969c6236693", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fab8801c7b0 con 0x7fab94124460 2026-02-24T17:24:55.272 INFO:teuthology.orchestra.run.trial120.stdout:5 2026-02-24T17:24:55.273 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.265+0000 7fab9932e640 10 librados: watch_flush enter 2026-02-24T17:24:55.273 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.265+0000 7fab9932e640 10 librados: watch_flush exit 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.265+0000 7fab9932e640 20 client.4150.objecter shutdown clearing up homeless session... 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.265+0000 7fab9932e640 10 client.4150.objecter successfully canceled tick 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.265+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fab94124460 msgr2=0x7fab9412e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.265+0000 7fab9932e640 1 --2- 10.20.193.120:0/3575426771 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fab94124460 0x7fab9412e360 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab8800c700 tx=0x7fab8800cbc0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.269+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 shutdown_connections 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.269+0000 7fab9932e640 1 --2- 10.20.193.120:0/3575426771 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fab94167ed0 0x7fab94133ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.269+0000 7fab9932e640 1 --2- 10.20.193.120:0/3575426771 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fab94146310 0x7fab9412e9d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.269+0000 7fab9932e640 1 --2- 10.20.193.120:0/3575426771 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fab94124460 0x7fab9412e360 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.269+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 >> 10.20.193.120:0/3575426771 conn(0x7fab94058430 msgr2=0x7fab94125100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.269+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 shutdown_connections 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.269+0000 7fab9932e640 1 -- 10.20.193.120:0/3575426771 wait complete. 2026-02-24T17:24:55.274 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.269+0000 7fab9932e640 1 librados: shutdown 2026-02-24T17:24:55.280 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new ca53011f-6445-46ff-bee3-5ac8c76d24f2 6 2026-02-24T17:24:55.281 INFO:tasks.ceph.mgr.x.trial120.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-24T17:24:55.286 INFO:tasks.ceph.mgr.x.trial120.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-24T17:24:55.338 INFO:tasks.ceph.mgr.x.trial120.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-24T17:24:55.348 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24cd9e7640 1 Processor -- start 2026-02-24T17:24:55.348 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24cd9e7640 1 -- start start 2026-02-24T17:24:55.348 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24cd9e7640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f24c8124460 0x7f24c8124830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.349 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24cd9e7640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f24c811f470 0x7f24c811f8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.349 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24cd9e7640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f24c811fe30 0x7f24c8186330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.349 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24cd9e7640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f24c8186870 con 0x7f24c811fe30 2026-02-24T17:24:55.349 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24cd9e7640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f24c81869f0 con 0x7f24c8124460 2026-02-24T17:24:55.349 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24cd9e7640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f24c8186b70 con 0x7f24c811f470 2026-02-24T17:24:55.350 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c77fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f24c811fe30 0x7f24c8186330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.350 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c6ffd640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f24c8124460 0x7f24c8124830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.350 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c77fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f24c811fe30 0x7f24c8186330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39544/0 (socket says 10.20.193.120:39544) 2026-02-24T17:24:55.350 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c77fe640 1 -- 10.20.193.120:0/2603928039 learned_addr learned my addr 10.20.193.120:0/2603928039 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.350 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c67fc640 1 --2- 10.20.193.120:0/2603928039 >> v2:10.20.193.109:3300/0 conn(0x7f24c811f470 0x7f24c811f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.350 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c67fc640 1 -- 10.20.193.120:0/2603928039 >> v2:10.20.193.94:3300/0 conn(0x7f24c8124460 msgr2=0x7f24c8124830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.351 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c67fc640 1 --2- 10.20.193.120:0/2603928039 >> v2:10.20.193.94:3300/0 conn(0x7f24c8124460 0x7f24c8124830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.351 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c67fc640 1 -- 10.20.193.120:0/2603928039 >> v2:10.20.193.40:3300/0 conn(0x7f24c811fe30 msgr2=0x7f24c8186330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.351 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c67fc640 1 --2- 10.20.193.120:0/2603928039 >> v2:10.20.193.40:3300/0 conn(0x7f24c811fe30 0x7f24c8186330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.351 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.333+0000 7f24c67fc640 1 -- 10.20.193.120:0/2603928039 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c8186cf0 con 0x7f24c811f470 2026-02-24T17:24:55.351 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 --2- 10.20.193.120:0/2603928039 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 0x7f24c811f8f0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=17079372619261242451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24c811f350 tx=0x7f24b001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed061ee825996c53 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.351 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c5ffb640 1 -- 10.20.193.120:0/2603928039 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24b00b0070 con 0x7f24c811f470 2026-02-24T17:24:55.352 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c5ffb640 1 -- 10.20.193.120:0/2603928039 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00ab620 con 0x7f24c811f470 2026-02-24T17:24:55.352 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c5ffb640 1 -- 10.20.193.120:0/2603928039 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24b00aba10 con 0x7f24c811f470 2026-02-24T17:24:55.352 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- 10.20.193.120:0/2603928039 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 msgr2=0x7f24c811f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.352 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 --2- 10.20.193.120:0/2603928039 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 0x7f24c811f8f0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=17079372619261242451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24c811f350 tx=0x7f24b001c3e0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.352 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- 10.20.193.120:0/2603928039 shutdown_connections 2026-02-24T17:24:55.352 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 --2- 10.20.193.120:0/2603928039 >> v2:10.20.193.40:3300/0 conn(0x7f24c811fe30 0x7f24c8186330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.353 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 --2- 10.20.193.120:0/2603928039 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 0x7f24c811f8f0 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=17079372619261242451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.353 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 --2- 10.20.193.120:0/2603928039 >> v2:10.20.193.94:3300/0 conn(0x7f24c8124460 0x7f24c8124830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.353 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- 10.20.193.120:0/2603928039 >> 10.20.193.120:0/2603928039 conn(0x7f24c8058430 msgr2=0x7f24c8058830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.353 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- 10.20.193.120:0/2603928039 shutdown_connections 2026-02-24T17:24:55.353 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- 10.20.193.120:0/2603928039 wait complete. 2026-02-24T17:24:55.353 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 librados: starting msgr at 2026-02-24T17:24:55.354 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 librados: starting objecter 2026-02-24T17:24:55.354 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 Processor -- start 2026-02-24T17:24:55.354 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- start start 2026-02-24T17:24:55.354 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 librados: setting wanted keys 2026-02-24T17:24:55.354 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 librados: calling monclient init 2026-02-24T17:24:55.354 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 0x7f24c8108220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.355 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f24c811fe30 0x7f24c8186310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.355 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f24c8124460 0x7f24c8108a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.355 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f24c8189df0 con 0x7f24c811fe30 2026-02-24T17:24:55.355 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f24c8189c70 con 0x7f24c8124460 2026-02-24T17:24:55.355 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f24c8189f70 con 0x7f24c811f470 2026-02-24T17:24:55.355 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f24c811fe30 0x7f24c8186310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.355 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c77fe640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f24c8124460 0x7f24c8108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.356 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f24c811fe30 0x7f24c8186310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39554/0 (socket says 10.20.193.120:39554) 2026-02-24T17:24:55.356 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c77fe640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f24c8124460 0x7f24c8108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50478/0 (socket says 10.20.193.120:50478) 2026-02-24T17:24:55.356 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 -- 10.20.193.120:0/3418877282 learned_addr learned my addr 10.20.193.120:0/3418877282 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.356 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c6ffd640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 0x7f24c8108220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.356 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 -- 10.20.193.120:0/3418877282 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 msgr2=0x7f24c8108220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.356 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 0x7f24c8108220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.357 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 -- 10.20.193.120:0/3418877282 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f24c8124460 msgr2=0x7f24c8108a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.357 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f24c8124460 0x7f24c8108a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.357 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 -- 10.20.193.120:0/3418877282 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c810ddc0 con 0x7f24c811fe30 2026-02-24T17:24:55.357 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c77fe640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f24c8124460 0x7f24c8108a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:55.357 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24c67fc640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f24c811fe30 0x7f24c8186310 secure :-1 s=READY pgs=32 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24b001c420 tx=0x7f24b0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.357 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 10 client.?.objecter ms_handle_connect 0x7f24c811fe30 2026-02-24T17:24:55.358 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.358 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 1 -- 10.20.193.120:0/3418877282 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24b00b0040 con 0x7f24c811fe30 2026-02-24T17:24:55.358 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c810e050 con 0x7f24c811fe30 2026-02-24T17:24:55.358 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 1 -- 10.20.193.120:0/3418877282 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00b9070 con 0x7f24c811fe30 2026-02-24T17:24:55.358 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 1 -- 10.20.193.120:0/3418877282 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24b00abc10 con 0x7f24c811fe30 2026-02-24T17:24:55.358 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 10 client.4158.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.359 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c810e480 con 0x7f24c811fe30 2026-02-24T17:24:55.359 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 librados: init done 2026-02-24T17:24:55.359 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 1 -- 10.20.193.120:0/3418877282 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f24b00b3070 con 0x7f24c811fe30 2026-02-24T17:24:55.359 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 1 -- 10.20.193.120:0/3418877282 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (secure 0 0 0) 0x7f24b00abdb0 con 0x7f24c811fe30 2026-02-24T17:24:55.359 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 10 client.4158.objecter ms_dispatch2 0x7f24c8000ba0 osd_map(8..8 src has 1..8) 2026-02-24T17:24:55.359 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 3 client.4158.objecter handle_osd_map got epochs [8,8] > 0 2026-02-24T17:24:55.360 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 3 client.4158.objecter handle_osd_map decoding full epoch 8 2026-02-24T17:24:55.360 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f249ffff640 20 client.4158.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.360 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.337+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c8124830 con 0x7f24c811fe30 2026-02-24T17:24:55.360 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.341+0000 7f249ffff640 1 -- 10.20.193.120:0/3418877282 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f24b00160f0 con 0x7f24c811fe30 2026-02-24T17:24:55.377 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca53011f-6445-46ff-bee3-5ac8c76d24f2", "id": 6} v 0) -- 0x7f24c810e6e0 con 0x7f24c811fe30 2026-02-24T17:24:55.378 INFO:tasks.ceph.mgr.y.trial040.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-24T17:24:55.379 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f249ffff640 1 -- 10.20.193.120:0/3418877282 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca53011f-6445-46ff-bee3-5ac8c76d24f2", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f24b0003710 con 0x7f24c811fe30 2026-02-24T17:24:55.379 INFO:teuthology.orchestra.run.trial120.stdout:6 2026-02-24T17:24:55.380 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 10 librados: watch_flush enter 2026-02-24T17:24:55.380 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 10 librados: watch_flush exit 2026-02-24T17:24:55.380 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 20 client.4158.objecter shutdown clearing up homeless session... 2026-02-24T17:24:55.380 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 10 client.4158.objecter successfully canceled tick 2026-02-24T17:24:55.380 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f24c811fe30 msgr2=0x7f24c8186310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.380 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f24c811fe30 0x7f24c8186310 secure :-1 s=READY pgs=32 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24b001c420 tx=0x7f24b0019180 comp rx=0 tx=0).stop 2026-02-24T17:24:55.380 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 shutdown_connections 2026-02-24T17:24:55.380 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f24c8124460 0x7f24c8108a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.381 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f24c811fe30 0x7f24c8186310 unknown :-1 s=CLOSED pgs=32 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.381 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 --2- 10.20.193.120:0/3418877282 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f24c811f470 0x7f24c8108220 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.381 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 >> 10.20.193.120:0/3418877282 conn(0x7f24c8058430 msgr2=0x7f24c8102680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.381 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 shutdown_connections 2026-02-24T17:24:55.381 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 -- 10.20.193.120:0/3418877282 wait complete. 2026-02-24T17:24:55.381 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.373+0000 7f24cd9e7640 1 librados: shutdown 2026-02-24T17:24:55.387 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new c4862062-f74a-4802-be50-4ac14c0f40f8 7 2026-02-24T17:24:55.431 INFO:tasks.ceph.mgr.y.trial040.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-24T17:24:55.436 INFO:tasks.ceph.mgr.y.trial040.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-24T17:24:55.485 INFO:tasks.ceph.mgr.y.trial040.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-24T17:24:55.489 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65afe84640 1 Processor -- start 2026-02-24T17:24:55.489 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65afe84640 1 -- start start 2026-02-24T17:24:55.489 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65afe84640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f65a8124460 0x7f65a8124830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65afe84640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f65a811f470 0x7f65a811f8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65afe84640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f65a811fe30 0x7f65a8186330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65afe84640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f65a8186870 con 0x7f65a811fe30 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65afe84640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f65a81869f0 con 0x7f65a8124460 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65afe84640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f65a8186b70 con 0x7f65a811f470 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f65a8124460 0x7f65a8124830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f65a8124460 0x7f65a8124830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50484/0 (socket says 10.20.193.120:50484) 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 -- 10.20.193.120:0/796192100 learned_addr learned my addr 10.20.193.120:0/796192100 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65ae3fa640 1 --2- 10.20.193.120:0/796192100 >> v2:10.20.193.40:3300/0 conn(0x7f65a811fe30 0x7f65a8186330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65ad3f8640 1 --2- 10.20.193.120:0/796192100 >> v2:10.20.193.109:3300/0 conn(0x7f65a811f470 0x7f65a811f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 -- 10.20.193.120:0/796192100 >> v2:10.20.193.109:3300/0 conn(0x7f65a811f470 msgr2=0x7f65a811f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 --2- 10.20.193.120:0/796192100 >> v2:10.20.193.109:3300/0 conn(0x7f65a811f470 0x7f65a811f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 -- 10.20.193.120:0/796192100 >> v2:10.20.193.40:3300/0 conn(0x7f65a811fe30 msgr2=0x7f65a8186330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 --2- 10.20.193.120:0/796192100 >> v2:10.20.193.40:3300/0 conn(0x7f65a811fe30 0x7f65a8186330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.490 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 -- 10.20.193.120:0/796192100 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a8186cf0 con 0x7f65a8124460 2026-02-24T17:24:55.491 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65adbf9640 1 --2- 10.20.193.120:0/796192100 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 0x7f65a8124830 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=16949786446098025243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65a811f350 tx=0x7f659801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb39bcf80a674b1b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.491 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65acbf7640 1 -- 10.20.193.120:0/796192100 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65980b1070 con 0x7f65a8124460 2026-02-24T17:24:55.491 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65acbf7640 1 -- 10.20.193.120:0/796192100 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65980ac670 con 0x7f65a8124460 2026-02-24T17:24:55.491 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.485+0000 7f65acbf7640 1 -- 10.20.193.120:0/796192100 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65980aca60 con 0x7f65a8124460 2026-02-24T17:24:55.491 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- 10.20.193.120:0/796192100 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 msgr2=0x7f65a8124830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.491 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 --2- 10.20.193.120:0/796192100 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 0x7f65a8124830 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=16949786446098025243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65a811f350 tx=0x7f659801c4a0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.492 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- 10.20.193.120:0/796192100 shutdown_connections 2026-02-24T17:24:55.492 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 --2- 10.20.193.120:0/796192100 >> v2:10.20.193.40:3300/0 conn(0x7f65a811fe30 0x7f65a8186330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.492 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 --2- 10.20.193.120:0/796192100 >> v2:10.20.193.109:3300/0 conn(0x7f65a811f470 0x7f65a811f8f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.492 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 --2- 10.20.193.120:0/796192100 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 0x7f65a8124830 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=16949786446098025243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.492 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- 10.20.193.120:0/796192100 >> 10.20.193.120:0/796192100 conn(0x7f65a8058430 msgr2=0x7f65a8058830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.492 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- 10.20.193.120:0/796192100 shutdown_connections 2026-02-24T17:24:55.492 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- 10.20.193.120:0/796192100 wait complete. 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 librados: starting msgr at 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 librados: starting objecter 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 Processor -- start 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- start start 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 librados: setting wanted keys 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 librados: calling monclient init 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f65a811f470 0x7f65a81081c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f65a811fe30 0x7f65a8186310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 0x7f65a8108a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8189d90 con 0x7f65a811fe30 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8189c10 con 0x7f65a8124460 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8189f10 con 0x7f65a811f470 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65adbf9640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f65a811f470 0x7f65a81081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65ae3fa640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 0x7f65a8108a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65adbf9640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f65a811f470 0x7f65a81081c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:38068/0 (socket says 10.20.193.120:38068) 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65adbf9640 1 -- 10.20.193.120:0/4113634387 learned_addr learned my addr 10.20.193.120:0/4113634387 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65ad3f8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f65a811fe30 0x7f65a8186310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65ae3fa640 1 -- 10.20.193.120:0/4113634387 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f65a811f470 msgr2=0x7f65a81081c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65ae3fa640 1 --2- 10.20.193.120:0/4113634387 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f65a811f470 0x7f65a81081c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65ae3fa640 1 -- 10.20.193.120:0/4113634387 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f65a811fe30 msgr2=0x7f65a8186310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65ae3fa640 1 --2- 10.20.193.120:0/4113634387 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f65a811fe30 0x7f65a8186310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.493 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65ae3fa640 1 -- 10.20.193.120:0/4113634387 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a810dd60 con 0x7f65a8124460 2026-02-24T17:24:55.494 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65ae3fa640 1 --2- 10.20.193.120:0/4113634387 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 0x7f65a8108a10 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65a400fbf0 tx=0x7f65a400d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 10 client.?.objecter ms_handle_connect 0x7f65a8124460 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 1 -- 10.20.193.120:0/4113634387 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65a4019030 con 0x7f65a8124460 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 1 -- 10.20.193.120:0/4113634387 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a400fe00 con 0x7f65a8124460 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a810e050 con 0x7f65a8124460 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 1 -- 10.20.193.120:0/4113634387 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65a40156c0 con 0x7f65a8124460 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 10 client.4162.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a810e5e0 con 0x7f65a8124460 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 librados: init done 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 1 -- 10.20.193.120:0/4113634387 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f65a4026060 con 0x7f65a8124460 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 1 -- 10.20.193.120:0/4113634387 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (secure 0 0 0) 0x7f65a401a070 con 0x7f65a8124460 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 10 client.4162.objecter ms_dispatch2 0x7f65a8000ba0 osd_map(9..9 src has 1..9) 2026-02-24T17:24:55.495 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 3 client.4162.objecter handle_osd_map got epochs [9,9] > 0 2026-02-24T17:24:55.496 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 3 client.4162.objecter handle_osd_map decoding full epoch 9 2026-02-24T17:24:55.496 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 20 client.4162.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.496 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a8124830 con 0x7f65a8124460 2026-02-24T17:24:55.496 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.489+0000 7f65967fc640 1 -- 10.20.193.120:0/4113634387 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f65a4011040 con 0x7f65a8124460 2026-02-24T17:24:55.530 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.525+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4862062-f74a-4802-be50-4ac14c0f40f8", "id": 7} v 0) -- 0x7f65a8057410 con 0x7f65a8124460 2026-02-24T17:24:55.532 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.525+0000 7f65967fc640 1 -- 10.20.193.120:0/4113634387 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4862062-f74a-4802-be50-4ac14c0f40f8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f65a401ec10 con 0x7f65a8124460 2026-02-24T17:24:55.532 INFO:teuthology.orchestra.run.trial120.stdout:7 2026-02-24T17:24:55.535 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 10 librados: watch_flush enter 2026-02-24T17:24:55.535 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 10 librados: watch_flush exit 2026-02-24T17:24:55.535 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 20 client.4162.objecter shutdown clearing up homeless session... 2026-02-24T17:24:55.535 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 10 client.4162.objecter successfully canceled tick 2026-02-24T17:24:55.535 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 msgr2=0x7f65a8108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.536 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 --2- 10.20.193.120:0/4113634387 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 0x7f65a8108a10 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65a400fbf0 tx=0x7f65a400d490 comp rx=0 tx=0).stop 2026-02-24T17:24:55.536 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 shutdown_connections 2026-02-24T17:24:55.536 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 --2- 10.20.193.120:0/4113634387 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f65a8124460 0x7f65a8108a10 unknown :-1 s=CLOSED pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.536 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 --2- 10.20.193.120:0/4113634387 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f65a811fe30 0x7f65a8186310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.536 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 --2- 10.20.193.120:0/4113634387 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f65a811f470 0x7f65a81081c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.536 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 >> 10.20.193.120:0/4113634387 conn(0x7f65a8058430 msgr2=0x7f65a81025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.537 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 shutdown_connections 2026-02-24T17:24:55.537 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 -- 10.20.193.120:0/4113634387 wait complete. 2026-02-24T17:24:55.537 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.529+0000 7f65afe84640 1 librados: shutdown 2026-02-24T17:24:55.541 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new ecbb5459-70a3-4d39-910c-27e89ee16ef6 8 2026-02-24T17:24:55.599 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea9754a640 1 Processor -- start 2026-02-24T17:24:55.599 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea9754a640 1 -- start start 2026-02-24T17:24:55.599 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea9754a640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fea90146310 0x7fea901666f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.599 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea9754a640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 0x7fea90187180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.599 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea9754a640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea901878a0 con 0x7fea90124460 2026-02-24T17:24:55.599 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea9754a640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fea90188ac0 con 0x7fea90166cf0 2026-02-24T17:24:55.599 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea9754a640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fea90188c40 con 0x7fea90146310 2026-02-24T17:24:55.599 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea94abe640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fea90146310 0x7fea901666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea952bf640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fea90124460 0x7fea90124830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.120:51538/0 (socket says 10.20.193.120:51538) 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea95ac0640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 0x7fea90187180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea94abe640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fea90146310 0x7fea901666f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:38074/0 (socket says 10.20.193.120:38074) 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea952bf640 1 -- 10.20.193.120:0/2917064469 learned_addr learned my addr 10.20.193.120:0/2917064469 (peer_addr_for_me v1:10.20.193.120:0/0) 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea95ac0640 1 -- 10.20.193.120:0/2917064469 >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 msgr2=0x7fea90187180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea95ac0640 1 -- 10.20.193.120:0/2917064469 >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 msgr2=0x7fea90187180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea95ac0640 1 --2- 10.20.193.120:0/2917064469 >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 0x7fea90187180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea95ac0640 1 --2- 10.20.193.120:0/2917064469 >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 0x7fea90187180 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea94abe640 1 -- 10.20.193.120:0/2917064469 >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 msgr2=0x7fea90187180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea94abe640 1 --2- 10.20.193.120:0/2917064469 >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 0x7fea90187180 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.600 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea94abe640 1 -- 10.20.193.120:0/2917064469 >> v1:10.20.193.40:6789/0 conn(0x7fea90124460 legacy=0x7fea90124830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.601 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.593+0000 7fea94abe640 1 -- 10.20.193.120:0/2917064469 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea90188df0 con 0x7fea90146310 2026-02-24T17:24:55.604 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea94abe640 1 --2- 10.20.193.120:0/2917064469 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90146310 0x7fea901666f0 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=2601939956150163583 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea901250a0 tx=0x7fea8401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=241bf29abd39d87f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7ffff640 1 -- 10.20.193.120:0/2917064469 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea840ab640 con 0x7fea90146310 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7ffff640 1 -- 10.20.193.120:0/2917064469 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea840b0070 con 0x7fea90146310 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7ffff640 1 -- 10.20.193.120:0/2917064469 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea840aba20 con 0x7fea90146310 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- 10.20.193.120:0/2917064469 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90146310 msgr2=0x7fea901666f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 --2- 10.20.193.120:0/2917064469 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90146310 0x7fea901666f0 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=2601939956150163583 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea901250a0 tx=0x7fea8401c400 comp rx=0 tx=0).stop 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- 10.20.193.120:0/2917064469 shutdown_connections 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 --2- 10.20.193.120:0/2917064469 >> v2:10.20.193.40:3300/0 conn(0x7fea90166cf0 0x7fea90187180 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 --2- 10.20.193.120:0/2917064469 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90146310 0x7fea901666f0 unknown :-1 s=CLOSED pgs=24 gs=2 cs=0 l=1 c_cookie=2601939956150163583 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- 10.20.193.120:0/2917064469 >> 10.20.193.120:0/2917064469 conn(0x7fea90058430 msgr2=0x7fea90058830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.605 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- 10.20.193.120:0/2917064469 shutdown_connections 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- 10.20.193.120:0/2917064469 wait complete. 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 librados: starting msgr at 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 librados: starting objecter 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 Processor -- start 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- start start 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 librados: setting wanted keys 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 librados: calling monclient init 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea90124460 0x7fea90187160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea90146310 0x7fea9012f370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90166cf0 0x7fea9012fa40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.606 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fea901886f0 con 0x7fea90124460 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fea90188570 con 0x7fea90146310 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fea90188870 con 0x7fea90166cf0 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea90124460 0x7fea90187160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea95ac0640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90166cf0 0x7fea9012fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea94abe640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea90146310 0x7fea9012f370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea90124460 0x7fea90187160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39578/0 (socket says 10.20.193.120:39578) 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 -- 10.20.193.120:0/968983010 learned_addr learned my addr 10.20.193.120:0/968983010 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 -- 10.20.193.120:0/968983010 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90166cf0 msgr2=0x7fea9012fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 --2- 10.20.193.120:0/968983010 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90166cf0 0x7fea9012fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 -- 10.20.193.120:0/968983010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea90146310 msgr2=0x7fea9012f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 --2- 10.20.193.120:0/968983010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea90146310 0x7fea9012f370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.607 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 -- 10.20.193.120:0/968983010 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea90134d90 con 0x7fea90124460 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea94abe640 1 --2- 10.20.193.120:0/968983010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea90146310 0x7fea9012f370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea952bf640 1 --2- 10.20.193.120:0/968983010 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea90124460 0x7fea90187160 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea8000c700 tx=0x7fea8000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 10 client.?.objecter ms_handle_connect 0x7fea90124460 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 1 -- 10.20.193.120:0/968983010 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea80017070 con 0x7fea90124460 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea90135080 con 0x7fea90124460 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 1 -- 10.20.193.120:0/968983010 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea80005bf0 con 0x7fea90124460 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 1 -- 10.20.193.120:0/968983010 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea80007070 con 0x7fea90124460 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 10 client.4173.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea90135610 con 0x7fea90124460 2026-02-24T17:24:55.608 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 librados: init done 2026-02-24T17:24:55.609 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 1 -- 10.20.193.120:0/968983010 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fea80007620 con 0x7fea90124460 2026-02-24T17:24:55.609 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 1 -- 10.20.193.120:0/968983010 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (secure 0 0 0) 0x7fea8001b3b0 con 0x7fea90124460 2026-02-24T17:24:55.609 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 10 client.4173.objecter ms_dispatch2 0x7fea90000ba0 osd_map(10..10 src has 1..10) 2026-02-24T17:24:55.609 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 3 client.4173.objecter handle_osd_map got epochs [10,10] > 0 2026-02-24T17:24:55.609 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 3 client.4173.objecter handle_osd_map decoding full epoch 10 2026-02-24T17:24:55.609 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea7dffb640 20 client.4173.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.609 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.597+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea90124830 con 0x7fea90124460 2026-02-24T17:24:55.609 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.601+0000 7fea7dffb640 1 -- 10.20.193.120:0/968983010 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7fea80021070 con 0x7fea90124460 2026-02-24T17:24:55.636 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ecbb5459-70a3-4d39-910c-27e89ee16ef6", "id": 8} v 0) -- 0x7fea90057410 con 0x7fea90124460 2026-02-24T17:24:55.637 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea7dffb640 1 -- 10.20.193.120:0/968983010 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ecbb5459-70a3-4d39-910c-27e89ee16ef6", "id": 8}]=0 v11) ==== 112+0+2 (secure 0 0 0) 0x7fea8001c7b0 con 0x7fea90124460 2026-02-24T17:24:55.637 INFO:teuthology.orchestra.run.trial120.stdout:8 2026-02-24T17:24:55.637 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 10 librados: watch_flush enter 2026-02-24T17:24:55.637 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 10 librados: watch_flush exit 2026-02-24T17:24:55.637 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 20 client.4173.objecter shutdown clearing up homeless session... 2026-02-24T17:24:55.637 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 10 client.4173.objecter successfully canceled tick 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea90124460 msgr2=0x7fea90187160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 --2- 10.20.193.120:0/968983010 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea90124460 0x7fea90187160 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea8000c700 tx=0x7fea8000cbc0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 shutdown_connections 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 --2- 10.20.193.120:0/968983010 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea90166cf0 0x7fea9012fa40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 --2- 10.20.193.120:0/968983010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea90146310 0x7fea9012f370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 --2- 10.20.193.120:0/968983010 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea90124460 0x7fea90187160 unknown :-1 s=CLOSED pgs=34 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 >> 10.20.193.120:0/968983010 conn(0x7fea90058430 msgr2=0x7fea90123770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 shutdown_connections 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 -- 10.20.193.120:0/968983010 wait complete. 2026-02-24T17:24:55.638 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.633+0000 7fea9754a640 1 librados: shutdown 2026-02-24T17:24:55.645 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new c08fc40c-17cc-44e9-9250-afa1539de8c1 9 2026-02-24T17:24:55.705 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f65701640 1 Processor -- start 2026-02-24T17:24:55.705 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f65701640 1 -- start start 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f65701640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f2f60123b00 0x7f2f60123f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f65701640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f60124580 con 0x7f2f6005c300 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f65701640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f60124750 con 0x7f2f6005b820 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f65701640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2f6018f3c0 con 0x7f2f60123b00 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5effd640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7f2f6005b820 0x7f2f6005bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.120:49874/0 (socket says 10.20.193.120:49874) 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5effd640 1 -- 10.20.193.120:0/1790353674 learned_addr learned my addr 10.20.193.120:0/1790353674 (peer_addr_for_me v1:10.20.193.120:0/0) 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5f7fe640 1 --2- 10.20.193.120:0/1790353674 >> v2:10.20.193.94:3300/0 conn(0x7f2f60123b00 0x7f2f60123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5dffb640 1 -- 10.20.193.120:0/1790353674 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651822693 0 0) 0x7f2f60124750 con 0x7f2f6005b820 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5f7fe640 1 -- 10.20.193.120:0/1790353674 >> v1:10.20.193.109:6789/0 conn(0x7f2f6005b820 legacy=0x7f2f6005bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.706 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5f7fe640 1 -- 10.20.193.120:0/1790353674 >> v1:10.20.193.40:6789/0 conn(0x7f2f6005c300 legacy=0x7f2f601223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.708 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5f7fe640 1 -- 10.20.193.120:0/1790353674 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f60124920 con 0x7f2f60123b00 2026-02-24T17:24:55.708 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5f7fe640 1 --2- 10.20.193.120:0/1790353674 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f60123b00 0x7f2f60123f80 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=852423020877310878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f50004780 tx=0x7f2f5001c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd46a389dc1eb9e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.708 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5dffb640 1 -- 10.20.193.120:0/1790353674 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f500ab680 con 0x7f2f60123b00 2026-02-24T17:24:55.708 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5dffb640 1 -- 10.20.193.120:0/1790353674 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f500b0070 con 0x7f2f60123b00 2026-02-24T17:24:55.708 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.701+0000 7f2f5dffb640 1 -- 10.20.193.120:0/1790353674 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f500aba60 con 0x7f2f60123b00 2026-02-24T17:24:55.708 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- 10.20.193.120:0/1790353674 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f60123b00 msgr2=0x7f2f60123f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.708 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 --2- 10.20.193.120:0/1790353674 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f60123b00 0x7f2f60123f80 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=852423020877310878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f50004780 tx=0x7f2f5001c440 comp rx=0 tx=0).stop 2026-02-24T17:24:55.708 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- 10.20.193.120:0/1790353674 shutdown_connections 2026-02-24T17:24:55.709 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 --2- 10.20.193.120:0/1790353674 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f60123b00 0x7f2f60123f80 unknown :-1 s=CLOSED pgs=25 gs=3 cs=0 l=1 c_cookie=852423020877310878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.709 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- 10.20.193.120:0/1790353674 >> 10.20.193.120:0/1790353674 conn(0x7f2f60059570 msgr2=0x7f2f60059970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.709 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- 10.20.193.120:0/1790353674 shutdown_connections 2026-02-24T17:24:55.710 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- 10.20.193.120:0/1790353674 wait complete. 2026-02-24T17:24:55.710 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 librados: starting msgr at 2026-02-24T17:24:55.710 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 librados: starting objecter 2026-02-24T17:24:55.710 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 Processor -- start 2026-02-24T17:24:55.710 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- start start 2026-02-24T17:24:55.710 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 librados: setting wanted keys 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 librados: calling monclient init 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f6005b820 0x7f2f6012c0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f6005c300 0x7f2f6012c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f60123b00 0x7f2f60131900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f601258b0 con 0x7f2f60123b00 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60125730 con 0x7f2f6005b820 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60125a30 con 0x7f2f6005c300 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5effd640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f6005b820 0x7f2f6012c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5f7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f60123b00 0x7f2f60131900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5e7fc640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f6005c300 0x7f2f6012c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.711 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5f7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f60123b00 0x7f2f60131900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39586/0 (socket says 10.20.193.120:39586) 2026-02-24T17:24:55.712 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5f7fe640 1 -- 10.20.193.120:0/230547348 learned_addr learned my addr 10.20.193.120:0/230547348 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.712 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5effd640 1 -- 10.20.193.120:0/230547348 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f6005c300 msgr2=0x7f2f6012c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.712 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5effd640 1 --2- 10.20.193.120:0/230547348 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f6005c300 0x7f2f6012c730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.712 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5effd640 1 -- 10.20.193.120:0/230547348 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f60123b00 msgr2=0x7f2f60131900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.712 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5effd640 1 --2- 10.20.193.120:0/230547348 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f60123b00 0x7f2f60131900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.712 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5effd640 1 -- 10.20.193.120:0/230547348 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f601321c0 con 0x7f2f6005b820 2026-02-24T17:24:55.712 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f5effd640 1 --2- 10.20.193.120:0/230547348 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f6005b820 0x7f2f6012c0c0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f58003ef0 tx=0x7f2f5800df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.713 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 10 client.?.objecter ms_handle_connect 0x7f2f6005b820 2026-02-24T17:24:55.713 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.713 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 1 -- 10.20.193.120:0/230547348 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f58019070 con 0x7f2f6005b820 2026-02-24T17:24:55.713 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 1 -- 10.20.193.120:0/230547348 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5800ba30 con 0x7f2f6005b820 2026-02-24T17:24:55.713 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f601324b0 con 0x7f2f6005b820 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 10 client.4171.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f60172d20 con 0x7f2f6005b820 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f65701640 1 librados: init done 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 1 -- 10.20.193.120:0/230547348 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f5800be40 con 0x7f2f6005b820 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 1 -- 10.20.193.120:0/230547348 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f2f5801d7c0 con 0x7f2f6005b820 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 1 -- 10.20.193.120:0/230547348 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1755+0+0 (secure 0 0 0) 0x7f2f58012aa0 con 0x7f2f6005b820 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 10 client.4171.objecter ms_dispatch2 0x7f2f60000ba0 osd_map(11..11 src has 1..11) 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 3 client.4171.objecter handle_osd_map got epochs [11,11] > 0 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 3 client.4171.objecter handle_osd_map decoding full epoch 11 2026-02-24T17:24:55.714 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.705+0000 7f2f3f7fe640 20 client.4171.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.715 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.709+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f20005130 con 0x7f2f6005b820 2026-02-24T17:24:55.716 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.713+0000 7f2f3f7fe640 1 -- 10.20.193.120:0/230547348 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f2f58008e20 con 0x7f2f6005b820 2026-02-24T17:24:55.777 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.773+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c08fc40c-17cc-44e9-9250-afa1539de8c1", "id": 9} v 0) -- 0x7f2f20005420 con 0x7f2f6005b820 2026-02-24T17:24:55.779 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.773+0000 7f2f3f7fe640 1 -- 10.20.193.120:0/230547348 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c08fc40c-17cc-44e9-9250-afa1539de8c1", "id": 9}]=0 v12) ==== 112+0+2 (secure 0 0 0) 0x7f2f58012d30 con 0x7f2f6005b820 2026-02-24T17:24:55.779 INFO:teuthology.orchestra.run.trial120.stdout:9 2026-02-24T17:24:55.779 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.773+0000 7f2f65701640 10 librados: watch_flush enter 2026-02-24T17:24:55.779 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 10 librados: watch_flush exit 2026-02-24T17:24:55.779 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 20 client.4171.objecter shutdown clearing up homeless session... 2026-02-24T17:24:55.779 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 10 client.4171.objecter successfully canceled tick 2026-02-24T17:24:55.779 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f6005b820 msgr2=0x7f2f6012c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 --2- 10.20.193.120:0/230547348 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f6005b820 0x7f2f6012c0c0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f58003ef0 tx=0x7f2f5800df70 comp rx=0 tx=0).stop 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 shutdown_connections 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 --2- 10.20.193.120:0/230547348 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f60123b00 0x7f2f60131900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 --2- 10.20.193.120:0/230547348 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f6005c300 0x7f2f6012c730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 --2- 10.20.193.120:0/230547348 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f6005b820 0x7f2f6012c0c0 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 >> 10.20.193.120:0/230547348 conn(0x7f2f60059570 msgr2=0x7f2f601232c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 shutdown_connections 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 -- 10.20.193.120:0/230547348 wait complete. 2026-02-24T17:24:55.780 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.777+0000 7f2f65701640 1 librados: shutdown 2026-02-24T17:24:55.784 INFO:tasks.ceph.mgr.x.trial120.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T17:24:55.784 INFO:tasks.ceph.mgr.x.trial120.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T17:24:55.784 INFO:tasks.ceph.mgr.x.trial120.stderr: from numpy import show_config as show_numpy_config 2026-02-24T17:24:55.790 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new 222e48db-8734-4e1b-885d-90de04f44ca8 10 2026-02-24T17:24:55.847 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.841+0000 7f352b26b640 1 Processor -- start 2026-02-24T17:24:55.847 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.841+0000 7f352b26b640 1 -- start start 2026-02-24T17:24:55.847 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f3524124290 0x7f3524124660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.847 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3524188890 con 0x7f352411fdd0 2026-02-24T17:24:55.848 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3524189ab0 con 0x7f352411f260 2026-02-24T17:24:55.848 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f352418acb0 con 0x7f3524124290 2026-02-24T17:24:55.848 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f3524124290 0x7f3524124660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.848 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f3524124290 0x7f3524124660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50530/0 (socket says 10.20.193.120:50530) 2026-02-24T17:24:55.848 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 -- 10.20.193.120:0/2210287945 learned_addr learned my addr 10.20.193.120:0/2210287945 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.848 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 -- 10.20.193.120:0/2210287945 >> v1:10.20.193.109:6789/0 conn(0x7f352411f260 legacy=0x7f352411f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.848 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 -- 10.20.193.120:0/2210287945 >> v1:10.20.193.40:6789/0 conn(0x7f352411fdd0 legacy=0x7f3524187170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.848 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 -- 10.20.193.120:0/2210287945 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352418ae80 con 0x7f3524124290 2026-02-24T17:24:55.849 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 --2- 10.20.193.120:0/2210287945 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3524124290 0x7f3524124660 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=11863613681501896401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35140090a0 tx=0x7f351401c590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4a405c986627ed1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.849 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f3529267640 1 -- 10.20.193.120:0/2210287945 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35140a9690 con 0x7f3524124290 2026-02-24T17:24:55.849 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f3529267640 1 -- 10.20.193.120:0/2210287945 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35140a9830 con 0x7f3524124290 2026-02-24T17:24:55.849 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f3529267640 1 -- 10.20.193.120:0/2210287945 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35140a9c20 con 0x7f3524124290 2026-02-24T17:24:55.849 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- 10.20.193.120:0/2210287945 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3524124290 msgr2=0x7f3524124660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.849 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 --2- 10.20.193.120:0/2210287945 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3524124290 0x7f3524124660 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=11863613681501896401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35140090a0 tx=0x7f351401c590 comp rx=0 tx=0).stop 2026-02-24T17:24:55.849 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- 10.20.193.120:0/2210287945 shutdown_connections 2026-02-24T17:24:55.849 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 --2- 10.20.193.120:0/2210287945 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3524124290 0x7f3524124660 unknown :-1 s=CLOSED pgs=27 gs=3 cs=0 l=1 c_cookie=11863613681501896401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- 10.20.193.120:0/2210287945 >> 10.20.193.120:0/2210287945 conn(0x7f3524057e00 msgr2=0x7f3524058200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- 10.20.193.120:0/2210287945 shutdown_connections 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- 10.20.193.120:0/2210287945 wait complete. 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 librados: starting msgr at 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 librados: starting objecter 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 Processor -- start 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- start start 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 librados: setting wanted keys 2026-02-24T17:24:55.850 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 librados: calling monclient init 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f352411f260 0x7f3524107060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f352411fdd0 0x7f35241076d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3524124290 0x7f352410c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f352418a890 con 0x7f3524124290 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f352418a710 con 0x7f352411fdd0 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352b26b640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f352418aa10 con 0x7f352411f260 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f352411f260 0x7f3524107060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f352411f260 0x7f3524107060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:38104/0 (socket says 10.20.193.120:38104) 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 -- 10.20.193.120:0/3250998919 learned_addr learned my addr 10.20.193.120:0/3250998919 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f3529a68640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f352411fdd0 0x7f35241076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.851 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352aa6a640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3524124290 0x7f352410c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 -- 10.20.193.120:0/3250998919 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f352411fdd0 msgr2=0x7f35241076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f352411fdd0 0x7f35241076d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 -- 10.20.193.120:0/3250998919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3524124290 msgr2=0x7f352410c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3524124290 0x7f352410c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.845+0000 7f352a269640 1 -- 10.20.193.120:0/3250998919 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352410d160 con 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f352a269640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f352411f260 0x7f3524107060 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3514002410 tx=0x7f351401add0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 10 client.?.objecter ms_handle_connect 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 1 -- 10.20.193.120:0/3250998919 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3514004240 con 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352410d3f0 con 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 1 -- 10.20.193.120:0/3250998919 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35140043e0 con 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 1 -- 10.20.193.120:0/3250998919 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35140b2a50 con 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f352b26b640 10 client.4181.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3524186170 con 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f352b26b640 1 librados: init done 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 1 -- 10.20.193.120:0/3250998919 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f35140b2bf0 con 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 1 -- 10.20.193.120:0/3250998919 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 1870+0+0 (secure 0 0 0) 0x7f35140bccc0 con 0x7f352411f260 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 10 client.4181.objecter ms_dispatch2 0x7f3524000ba0 osd_map(12..12 src has 1..12) 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 3 client.4181.objecter handle_osd_map got epochs [12,12] > 0 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 3 client.4181.objecter handle_osd_map decoding full epoch 12 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 20 client.4181.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.852 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3524124660 con 0x7f352411f260 2026-02-24T17:24:55.854 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.849+0000 7f350affd640 1 -- 10.20.193.120:0/3250998919 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f35140ca070 con 0x7f352411f260 2026-02-24T17:24:55.858 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.853+0000 7f350affd640 1 -- 10.20.193.120:0/3250998919 <== mon.2 v2:10.20.193.109:3300/0 7 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7f3514003710 con 0x7f352411f260 2026-02-24T17:24:55.887 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.881+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "osd new", "uuid": "222e48db-8734-4e1b-885d-90de04f44ca8", "id": 10} v 0) -- 0x7f35240ff330 con 0x7f352411f260 2026-02-24T17:24:55.889 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f350affd640 1 -- 10.20.193.120:0/3250998919 <== mon.2 v2:10.20.193.109:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "222e48db-8734-4e1b-885d-90de04f44ca8", "id": 10}]=0 v13) ==== 113+0+3 (secure 0 0 0) 0x7f35140b7070 con 0x7f352411f260 2026-02-24T17:24:55.889 INFO:teuthology.orchestra.run.trial120.stdout:10 2026-02-24T17:24:55.890 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 10 librados: watch_flush enter 2026-02-24T17:24:55.890 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 10 librados: watch_flush exit 2026-02-24T17:24:55.890 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 20 client.4181.objecter shutdown clearing up homeless session... 2026-02-24T17:24:55.890 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 10 client.4181.objecter successfully canceled tick 2026-02-24T17:24:55.890 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f352411f260 msgr2=0x7f3524107060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f352411f260 0x7f3524107060 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3514002410 tx=0x7f351401add0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 shutdown_connections 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3524124290 0x7f352410c8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f352411fdd0 0x7f35241076d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 --2- 10.20.193.120:0/3250998919 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f352411f260 0x7f3524107060 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 >> 10.20.193.120:0/3250998919 conn(0x7f3524057e00 msgr2=0x7f3524101530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 shutdown_connections 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 -- 10.20.193.120:0/3250998919 wait complete. 2026-02-24T17:24:55.891 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.885+0000 7f352b26b640 1 librados: shutdown 2026-02-24T17:24:55.901 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new c1ccd78b-db99-4911-8140-67f0af870949 11 2026-02-24T17:24:55.913 INFO:tasks.ceph.mgr.y.trial040.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T17:24:55.913 INFO:tasks.ceph.mgr.y.trial040.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T17:24:55.913 INFO:tasks.ceph.mgr.y.trial040.stderr: from numpy import show_config as show_numpy_config 2026-02-24T17:24:55.960 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f74264fa640 1 Processor -- start 2026-02-24T17:24:55.960 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f74264fa640 1 -- start start 2026-02-24T17:24:55.960 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f74264fa640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f742011e1c0 0x7f742011e590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.960 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f74264fa640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f74201670b0 0x7f7420187490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.960 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f74264fa640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74201879d0 con 0x7f742011ead0 2026-02-24T17:24:55.960 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f74264fa640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7420188bb0 con 0x7f742011e1c0 2026-02-24T17:24:55.960 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f74264fa640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f7420188d30 con 0x7f74201670b0 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f7424a70640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f74201670b0 0x7f7420187490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f741f7fe640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7f742011ead0 0x7f7420165990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.120:39340/0 (socket says 10.20.193.120:39340) 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f741f7fe640 1 -- 10.20.193.120:0/396205954 learned_addr learned my addr 10.20.193.120:0/396205954 (peer_addr_for_me v1:10.20.193.120:0/0) 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f7424a70640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f74201670b0 0x7f7420187490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:38202/0 (socket says 10.20.193.120:38202) 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f741ffff640 1 --2- 10.20.193.120:0/396205954 >> v2:10.20.193.40:3300/0 conn(0x7f742011e1c0 0x7f742011e590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f7424a70640 1 -- 10.20.193.120:0/396205954 >> v2:10.20.193.40:3300/0 conn(0x7f742011e1c0 msgr2=0x7f742011e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f7424a70640 1 --2- 10.20.193.120:0/396205954 >> v2:10.20.193.40:3300/0 conn(0x7f742011e1c0 0x7f742011e590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f7424a70640 1 -- 10.20.193.120:0/396205954 >> v1:10.20.193.94:6789/0 conn(0x7f742011ead0 legacy=0x7f7420165990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.961 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.953+0000 7f7424a70640 1 -- 10.20.193.120:0/396205954 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7420188eb0 con 0x7f74201670b0 2026-02-24T17:24:55.965 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f7424a70640 1 --2- 10.20.193.120:0/396205954 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 0x7f7420187490 secure :-1 s=READY pgs=33 gs=2 cs=0 l=1 c_cookie=4598337686043395525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7420120330 tx=0x7f741401d7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fd093c32de885c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741effd640 1 -- 10.20.193.120:0/396205954 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74140b3070 con 0x7f74201670b0 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741effd640 1 -- 10.20.193.120:0/396205954 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140a68c0 con 0x7f74201670b0 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741effd640 1 -- 10.20.193.120:0/396205954 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74140a6cd0 con 0x7f74201670b0 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- 10.20.193.120:0/396205954 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 msgr2=0x7f7420187490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 --2- 10.20.193.120:0/396205954 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 0x7f7420187490 secure :-1 s=READY pgs=33 gs=2 cs=0 l=1 c_cookie=4598337686043395525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7420120330 tx=0x7f741401d7b0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- 10.20.193.120:0/396205954 shutdown_connections 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 --2- 10.20.193.120:0/396205954 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 0x7f7420187490 unknown :-1 s=CLOSED pgs=33 gs=2 cs=0 l=1 c_cookie=4598337686043395525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 --2- 10.20.193.120:0/396205954 >> v2:10.20.193.40:3300/0 conn(0x7f742011e1c0 0x7f742011e590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- 10.20.193.120:0/396205954 >> 10.20.193.120:0/396205954 conn(0x7f7420059980 msgr2=0x7f7420059d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- 10.20.193.120:0/396205954 shutdown_connections 2026-02-24T17:24:55.966 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- 10.20.193.120:0/396205954 wait complete. 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 librados: starting msgr at 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 librados: starting objecter 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 Processor -- start 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- start start 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 librados: setting wanted keys 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 librados: calling monclient init 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f742011e1c0 0x7f7420107fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f742011ead0 0x7f7420108630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 0x7f742010d800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7420188820 con 0x7f742011e1c0 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f74201886a0 con 0x7f742011ead0 2026-02-24T17:24:55.967 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f74201889a0 con 0x7f74201670b0 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741f7fe640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f742011ead0 0x7f7420108630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741ffff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f742011e1c0 0x7f7420107fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741ffff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f742011e1c0 0x7f7420107fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39712/0 (socket says 10.20.193.120:39712) 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741ffff640 1 -- 10.20.193.120:0/3661226249 learned_addr learned my addr 10.20.193.120:0/3661226249 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f7424a70640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 0x7f742010d800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f7424a70640 1 -- 10.20.193.120:0/3661226249 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f742011ead0 msgr2=0x7f7420108630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f7424a70640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f742011ead0 0x7f7420108630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f7424a70640 1 -- 10.20.193.120:0/3661226249 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f742011e1c0 msgr2=0x7f7420107fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f7424a70640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f742011e1c0 0x7f7420107fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f7424a70640 1 -- 10.20.193.120:0/3661226249 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742010e0c0 con 0x7f74201670b0 2026-02-24T17:24:55.968 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741ffff640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f742011e1c0 0x7f7420107fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f7424a70640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 0x7f742010d800 secure :-1 s=READY pgs=34 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f741401a3c0 tx=0x7f741401a550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741cff9640 10 client.?.objecter ms_handle_connect 0x7f74201670b0 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741cff9640 1 -- 10.20.193.120:0/3661226249 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74140bd030 con 0x7f74201670b0 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741cff9640 1 -- 10.20.193.120:0/3661226249 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140afa20 con 0x7f74201670b0 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f741cff9640 1 -- 10.20.193.120:0/3661226249 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74140b3040 con 0x7f74201670b0 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742010e350 con 0x7f74201670b0 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 10 client.4202.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7420164980 con 0x7f74201670b0 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.957+0000 7f74264fa640 1 librados: init done 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.961+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742011e590 con 0x7f74201670b0 2026-02-24T17:24:55.969 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.961+0000 7f741cff9640 1 -- 10.20.193.120:0/3661226249 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7f74140ca060 con 0x7f74201670b0 2026-02-24T17:24:55.970 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.961+0000 7f741cff9640 1 -- 10.20.193.120:0/3661226249 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 1985+0+0 (secure 0 0 0) 0x7f74140be070 con 0x7f74201670b0 2026-02-24T17:24:55.970 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.961+0000 7f741cff9640 10 client.4202.objecter ms_dispatch2 0x7f7420000ba0 osd_map(13..13 src has 1..13) 2026-02-24T17:24:55.970 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.961+0000 7f741cff9640 3 client.4202.objecter handle_osd_map got epochs [13,13] > 0 2026-02-24T17:24:55.970 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.961+0000 7f741cff9640 3 client.4202.objecter handle_osd_map decoding full epoch 13 2026-02-24T17:24:55.970 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.961+0000 7f741cff9640 20 client.4202.objecter dump_active .. 0 homeless 2026-02-24T17:24:55.970 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.961+0000 7f741cff9640 1 -- 10.20.193.120:0/3661226249 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f74140174c0 con 0x7f74201670b0 2026-02-24T17:24:56.000 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1ccd78b-db99-4911-8140-67f0af870949", "id": 11} v 0) -- 0x7f7420164ca0 con 0x7f74201670b0 2026-02-24T17:24:56.002 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f741cff9640 1 -- 10.20.193.120:0/3661226249 <== mon.2 v2:10.20.193.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1ccd78b-db99-4911-8140-67f0af870949", "id": 11}]=0 v14) ==== 113+0+3 (secure 0 0 0) 0x7f74140b4ad0 con 0x7f74201670b0 2026-02-24T17:24:56.003 INFO:teuthology.orchestra.run.trial120.stdout:11 2026-02-24T17:24:56.004 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 10 librados: watch_flush enter 2026-02-24T17:24:56.004 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 10 librados: watch_flush exit 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 20 client.4202.objecter shutdown clearing up homeless session... 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 10 client.4202.objecter successfully canceled tick 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 msgr2=0x7f742010d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 0x7f742010d800 secure :-1 s=READY pgs=34 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f741401a3c0 tx=0x7f741401a550 comp rx=0 tx=0).stop 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 shutdown_connections 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f74201670b0 0x7f742010d800 unknown :-1 s=CLOSED pgs=34 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f742011ead0 0x7f7420108630 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 --2- 10.20.193.120:0/3661226249 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f742011e1c0 0x7f7420107fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 >> 10.20.193.120:0/3661226249 conn(0x7f7420059980 msgr2=0x7f7420102960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 shutdown_connections 2026-02-24T17:24:56.005 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 -- 10.20.193.120:0/3661226249 wait complete. 2026-02-24T17:24:56.006 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:55.997+0000 7f74264fa640 1 librados: shutdown 2026-02-24T17:24:56.015 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new 4c58eff7-882b-4bfd-9816-137d0e3ed5a6 12 2026-02-24T17:24:56.082 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8c5494640 1 Processor -- start 2026-02-24T17:24:56.082 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8c5494640 1 -- start start 2026-02-24T17:24:56.083 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8c5494640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fc8c005d6c0 0x7fc8c005da90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.083 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8c5494640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fc8c005e0c0 0x7fc8c0162220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.083 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8c5494640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc8c0162760 0x7fc8c0182be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.083 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8c5494640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c0183300 con 0x7fc8c0162760 2026-02-24T17:24:56.083 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8c5494640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c0183480 con 0x7fc8c005d6c0 2026-02-24T17:24:56.083 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8c5494640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c0183630 con 0x7fc8c005e0c0 2026-02-24T17:24:56.083 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8be7fc640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fc8c005e0c0 0x7fc8c0162220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.084 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8be7fc640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fc8c005e0c0 0x7fc8c0162220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:38216/0 (socket says 10.20.193.120:38216) 2026-02-24T17:24:56.084 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8be7fc640 1 -- 10.20.193.120:0/1960402939 learned_addr learned my addr 10.20.193.120:0/1960402939 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:56.084 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bf7fe640 1 --2- 10.20.193.120:0/1960402939 >> v2:10.20.193.40:3300/0 conn(0x7fc8c0162760 0x7fc8c0182be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.084 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8beffd640 1 --2- 10.20.193.120:0/1960402939 >> v2:10.20.193.94:3300/0 conn(0x7fc8c005d6c0 0x7fc8c005da90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.084 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bf7fe640 1 -- 10.20.193.120:0/1960402939 >> v2:10.20.193.109:3300/0 conn(0x7fc8c005e0c0 msgr2=0x7fc8c0162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:56.084 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bf7fe640 1 --2- 10.20.193.120:0/1960402939 >> v2:10.20.193.109:3300/0 conn(0x7fc8c005e0c0 0x7fc8c0162220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.084 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bf7fe640 1 -- 10.20.193.120:0/1960402939 >> v2:10.20.193.94:3300/0 conn(0x7fc8c005d6c0 msgr2=0x7fc8c005da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:56.085 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bf7fe640 1 --2- 10.20.193.120:0/1960402939 >> v2:10.20.193.94:3300/0 conn(0x7fc8c005d6c0 0x7fc8c005da90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.085 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bf7fe640 1 -- 10.20.193.120:0/1960402939 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c005c4b0 con 0x7fc8c0162760 2026-02-24T17:24:56.085 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8be7fc640 1 --2- 10.20.193.120:0/1960402939 >> v2:10.20.193.109:3300/0 conn(0x7fc8c005e0c0 0x7fc8c0162220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:56.085 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bf7fe640 1 --2- 10.20.193.120:0/1960402939 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c0162760 0x7fc8c0182be0 secure :-1 s=READY pgs=41 gs=3 cs=0 l=1 c_cookie=10091844133931151563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c0055a80 tx=0x7fc8b001d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0d6ec55b9370cb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.085 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bdffb640 1 -- 10.20.193.120:0/1960402939 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b00b3070 con 0x7fc8c0162760 2026-02-24T17:24:56.085 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bdffb640 1 -- 10.20.193.120:0/1960402939 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b00a6880 con 0x7fc8c0162760 2026-02-24T17:24:56.085 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.069+0000 7fc8bdffb640 1 -- 10.20.193.120:0/1960402939 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8b00a6c90 con 0x7fc8c0162760 2026-02-24T17:24:56.086 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- 10.20.193.120:0/1960402939 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c0162760 msgr2=0x7fc8c0182be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.086 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 --2- 10.20.193.120:0/1960402939 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c0162760 0x7fc8c0182be0 secure :-1 s=READY pgs=41 gs=3 cs=0 l=1 c_cookie=10091844133931151563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c0055a80 tx=0x7fc8b001d770 comp rx=0 tx=0).stop 2026-02-24T17:24:56.086 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- 10.20.193.120:0/1960402939 shutdown_connections 2026-02-24T17:24:56.086 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 --2- 10.20.193.120:0/1960402939 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c0162760 0x7fc8c0182be0 unknown :-1 s=CLOSED pgs=41 gs=3 cs=0 l=1 c_cookie=10091844133931151563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.086 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 --2- 10.20.193.120:0/1960402939 >> v2:10.20.193.109:3300/0 conn(0x7fc8c005e0c0 0x7fc8c0162220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.086 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 --2- 10.20.193.120:0/1960402939 >> v2:10.20.193.94:3300/0 conn(0x7fc8c005d6c0 0x7fc8c005da90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.086 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- 10.20.193.120:0/1960402939 >> 10.20.193.120:0/1960402939 conn(0x7fc8c0059980 msgr2=0x7fc8c0059d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.087 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- 10.20.193.120:0/1960402939 shutdown_connections 2026-02-24T17:24:56.087 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- 10.20.193.120:0/1960402939 wait complete. 2026-02-24T17:24:56.087 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 librados: starting msgr at 2026-02-24T17:24:56.087 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 librados: starting objecter 2026-02-24T17:24:56.087 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 Processor -- start 2026-02-24T17:24:56.087 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- start start 2026-02-24T17:24:56.087 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 librados: setting wanted keys 2026-02-24T17:24:56.088 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 librados: calling monclient init 2026-02-24T17:24:56.088 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8c005d6c0 0x7fc8c016fe60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.088 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c005e0c0 0x7fc8c01704d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.088 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8c0162760 0x7fc8c01756a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.088 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c005d390 con 0x7fc8c005e0c0 2026-02-24T17:24:56.088 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c005d210 con 0x7fc8c005d6c0 2026-02-24T17:24:56.088 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0187a50 con 0x7fc8c0162760 2026-02-24T17:24:56.089 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8bf7fe640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8c0162760 0x7fc8c01756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.089 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c005e0c0 0x7fc8c01704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.089 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c005e0c0 0x7fc8c01704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39728/0 (socket says 10.20.193.120:39728) 2026-02-24T17:24:56.089 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 -- 10.20.193.120:0/3646545175 learned_addr learned my addr 10.20.193.120:0/3646545175 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:56.089 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8beffd640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8c005d6c0 0x7fc8c016fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.089 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 -- 10.20.193.120:0/3646545175 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8c0162760 msgr2=0x7fc8c01756a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.089 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8c0162760 0x7fc8c01756a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.089 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 -- 10.20.193.120:0/3646545175 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8c005d6c0 msgr2=0x7fc8c016fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.090 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8c005d6c0 0x7fc8c016fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.090 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 -- 10.20.193.120:0/3646545175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c0175f60 con 0x7fc8c005e0c0 2026-02-24T17:24:56.090 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8bf7fe640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8c0162760 0x7fc8c01756a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:56.090 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8be7fc640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c005e0c0 0x7fc8c01704d0 secure :-1 s=READY pgs=42 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a80094d0 tx=0x7fc8a800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.090 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 10 client.?.objecter ms_handle_connect 0x7fc8c005e0c0 2026-02-24T17:24:56.090 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:56.090 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 1 -- 10.20.193.120:0/3646545175 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a800ce20 con 0x7fc8c005e0c0 2026-02-24T17:24:56.091 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 1 -- 10.20.193.120:0/3646545175 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a8004030 con 0x7fc8c005e0c0 2026-02-24T17:24:56.091 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c01761f0 con 0x7fc8c005e0c0 2026-02-24T17:24:56.091 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 1 -- 10.20.193.120:0/3646545175 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a8004440 con 0x7fc8c005e0c0 2026-02-24T17:24:56.091 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 10 client.4215.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:56.091 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c0183980 con 0x7fc8c005e0c0 2026-02-24T17:24:56.091 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 librados: init done 2026-02-24T17:24:56.091 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c0176580 con 0x7fc8c005e0c0 2026-02-24T17:24:56.091 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 1 -- 10.20.193.120:0/3646545175 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7fc8a8023060 con 0x7fc8c005e0c0 2026-02-24T17:24:56.092 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 1 -- 10.20.193.120:0/3646545175 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2100+0+0 (secure 0 0 0) 0x7fc8a800f040 con 0x7fc8c005e0c0 2026-02-24T17:24:56.092 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 10 client.4215.objecter ms_dispatch2 0x7fc8c0000ba0 osd_map(14..14 src has 1..14) 2026-02-24T17:24:56.092 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 3 client.4215.objecter handle_osd_map got epochs [14,14] > 0 2026-02-24T17:24:56.092 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 3 client.4215.objecter handle_osd_map decoding full epoch 14 2026-02-24T17:24:56.092 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.073+0000 7fc89f7fe640 20 client.4215.objecter dump_active .. 0 homeless 2026-02-24T17:24:56.092 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.077+0000 7fc89f7fe640 1 -- 10.20.193.120:0/3646545175 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7fc8a8017020 con 0x7fc8c005e0c0 2026-02-24T17:24:56.113 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4c58eff7-882b-4bfd-9816-137d0e3ed5a6", "id": 12} v 0) -- 0x7fc8c0057410 con 0x7fc8c005e0c0 2026-02-24T17:24:56.114 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc89f7fe640 1 -- 10.20.193.120:0/3646545175 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c58eff7-882b-4bfd-9816-137d0e3ed5a6", "id": 12}]=0 v15) ==== 113+0+3 (secure 0 0 0) 0x7fc8a801f9c0 con 0x7fc8c005e0c0 2026-02-24T17:24:56.114 INFO:teuthology.orchestra.run.trial120.stdout:12 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 10 librados: watch_flush enter 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 10 librados: watch_flush exit 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 20 client.4215.objecter shutdown clearing up homeless session... 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 10 client.4215.objecter successfully canceled tick 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c005e0c0 msgr2=0x7fc8c01704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c005e0c0 0x7fc8c01704d0 secure :-1 s=READY pgs=42 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a80094d0 tx=0x7fc8a800c520 comp rx=0 tx=0).stop 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 shutdown_connections 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8c0162760 0x7fc8c01756a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8c005e0c0 0x7fc8c01704d0 unknown :-1 s=CLOSED pgs=42 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 --2- 10.20.193.120:0/3646545175 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8c005d6c0 0x7fc8c016fe60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 >> 10.20.193.120:0/3646545175 conn(0x7fc8c0059980 msgr2=0x7fc8c016a320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 shutdown_connections 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 -- 10.20.193.120:0/3646545175 wait complete. 2026-02-24T17:24:56.115 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.109+0000 7fc8c5494640 1 librados: shutdown 2026-02-24T17:24:56.123 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new 013e1c78-dbc4-4789-9c0b-56e1e9f54a9d 13 2026-02-24T17:24:56.184 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90ac3f2640 1 Processor -- start 2026-02-24T17:24:56.184 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90ac3f2640 1 -- start start 2026-02-24T17:24:56.184 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90ac3f2640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f90a411e1c0 0x7f90a411e590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.184 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90ac3f2640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f90a411ead0 0x7f90a4165990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.184 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90ac3f2640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f90a4165ed0 0x7f90a41862b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90ac3f2640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f90a41867f0 con 0x7f90a411ead0 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90ac3f2640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f90a4186970 con 0x7f90a4165ed0 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90ac3f2640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f90a4186af0 con 0x7f90a411e1c0 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa968640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f90a4165ed0 0x7f90a41862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa968640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f90a4165ed0 0x7f90a41862b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50674/0 (socket says 10.20.193.120:50674) 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa968640 1 -- 10.20.193.120:0/1692136735 learned_addr learned my addr 10.20.193.120:0/1692136735 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90a9966640 1 --2- 10.20.193.120:0/1692136735 >> v2:10.20.193.40:3300/0 conn(0x7f90a411ead0 0x7f90a4165990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa167640 1 --2- 10.20.193.120:0/1692136735 >> v2:10.20.193.109:3300/0 conn(0x7f90a411e1c0 0x7f90a411e590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa968640 1 -- 10.20.193.120:0/1692136735 >> v2:10.20.193.109:3300/0 conn(0x7f90a411e1c0 msgr2=0x7f90a411e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa968640 1 --2- 10.20.193.120:0/1692136735 >> v2:10.20.193.109:3300/0 conn(0x7f90a411e1c0 0x7f90a411e590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa968640 1 -- 10.20.193.120:0/1692136735 >> v2:10.20.193.40:3300/0 conn(0x7f90a411ead0 msgr2=0x7f90a4165990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:56.185 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa968640 1 --2- 10.20.193.120:0/1692136735 >> v2:10.20.193.40:3300/0 conn(0x7f90a411ead0 0x7f90a4165990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.186 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.177+0000 7f90aa968640 1 -- 10.20.193.120:0/1692136735 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a4186c70 con 0x7f90a4165ed0 2026-02-24T17:24:56.190 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa968640 1 --2- 10.20.193.120:0/1692136735 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a4165ed0 0x7f90a41862b0 secure :-1 s=READY pgs=35 gs=3 cs=0 l=1 c_cookie=781296375634296426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90a411f1a0 tx=0x7f90a001d830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad7b8ea05fb7e6a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.190 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90a9165640 1 -- 10.20.193.120:0/1692136735 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90a00b3070 con 0x7f90a4165ed0 2026-02-24T17:24:56.190 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90a9165640 1 -- 10.20.193.120:0/1692136735 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a00a6830 con 0x7f90a4165ed0 2026-02-24T17:24:56.190 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90a9165640 1 -- 10.20.193.120:0/1692136735 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90a00a6c40 con 0x7f90a4165ed0 2026-02-24T17:24:56.190 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1692136735 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a4165ed0 msgr2=0x7f90a41862b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.190 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 --2- 10.20.193.120:0/1692136735 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a4165ed0 0x7f90a41862b0 secure :-1 s=READY pgs=35 gs=3 cs=0 l=1 c_cookie=781296375634296426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90a411f1a0 tx=0x7f90a001d830 comp rx=0 tx=0).stop 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1692136735 shutdown_connections 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 --2- 10.20.193.120:0/1692136735 >> v2:10.20.193.40:3300/0 conn(0x7f90a411ead0 0x7f90a4165990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 --2- 10.20.193.120:0/1692136735 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a4165ed0 0x7f90a41862b0 unknown :-1 s=CLOSED pgs=35 gs=3 cs=0 l=1 c_cookie=781296375634296426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 --2- 10.20.193.120:0/1692136735 >> v2:10.20.193.109:3300/0 conn(0x7f90a411e1c0 0x7f90a411e590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1692136735 >> 10.20.193.120:0/1692136735 conn(0x7f90a4059980 msgr2=0x7f90a4059d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1692136735 shutdown_connections 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1692136735 wait complete. 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 librados: starting msgr at 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 librados: starting objecter 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 Processor -- start 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- start start 2026-02-24T17:24:56.191 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 librados: setting wanted keys 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 librados: calling monclient init 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f90a411e1c0 0x7f90a4107fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a411ead0 0x7f90a4108650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f90a4165ed0 0x7f90a410d820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4189db0 con 0x7f90a4165ed0 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4189c30 con 0x7f90a411ead0 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90ac3f2640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4189f30 con 0x7f90a411e1c0 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa968640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f90a4165ed0 0x7f90a410d820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa167640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f90a411e1c0 0x7f90a4107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa167640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f90a411e1c0 0x7f90a4107fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.120:38238/0 (socket says 10.20.193.120:38238) 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa167640 1 -- 10.20.193.120:0/1247496010 learned_addr learned my addr 10.20.193.120:0/1247496010 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:56.192 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90a9966640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a411ead0 0x7f90a4108650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa167640 1 -- 10.20.193.120:0/1247496010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a411ead0 msgr2=0x7f90a4108650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa167640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a411ead0 0x7f90a4108650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa167640 1 -- 10.20.193.120:0/1247496010 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f90a4165ed0 msgr2=0x7f90a410d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa167640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f90a4165ed0 0x7f90a410d820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa167640 1 -- 10.20.193.120:0/1247496010 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a410e0e0 con 0x7f90a411e1c0 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90a9966640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a411ead0 0x7f90a4108650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.181+0000 7f90aa968640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f90a4165ed0 0x7f90a410d820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f90aa167640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f90a411e1c0 0x7f90a4107fe0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9094009430 tx=0x7f909400ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 10 client.?.objecter ms_handle_connect 0x7f90a411e1c0 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 1 -- 10.20.193.120:0/1247496010 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9094017070 con 0x7f90a411e1c0 2026-02-24T17:24:56.193 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a410e3d0 con 0x7f90a411e1c0 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 1 -- 10.20.193.120:0/1247496010 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909400cb60 con 0x7f90a411e1c0 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 1 -- 10.20.193.120:0/1247496010 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9094013470 con 0x7f90a411e1c0 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f90ac3f2640 10 client.4214.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a4164b50 con 0x7f90a411e1c0 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f90ac3f2640 1 librados: init done 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a411e590 con 0x7f90a411e1c0 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 1 -- 10.20.193.120:0/1247496010 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7f9094013610 con 0x7f90a411e1c0 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 1 -- 10.20.193.120:0/1247496010 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2215+0+0 (secure 0 0 0) 0x7f909400f040 con 0x7f90a411e1c0 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 10 client.4214.objecter ms_dispatch2 0x7f90a4000ba0 osd_map(15..15 src has 1..15) 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 3 client.4214.objecter handle_osd_map got epochs [15,15] > 0 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 3 client.4214.objecter handle_osd_map decoding full epoch 15 2026-02-24T17:24:56.194 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 20 client.4214.objecter dump_active .. 0 homeless 2026-02-24T17:24:56.195 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.185+0000 7f908affd640 1 -- 10.20.193.120:0/1247496010 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f909404ef70 con 0x7f90a411e1c0 2026-02-24T17:24:56.223 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.217+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "osd new", "uuid": "013e1c78-dbc4-4789-9c0b-56e1e9f54a9d", "id": 13} v 0) -- 0x7f90a4164e10 con 0x7f90a411e1c0 2026-02-24T17:24:56.225 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f908affd640 1 -- 10.20.193.120:0/1247496010 <== mon.2 v2:10.20.193.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "013e1c78-dbc4-4789-9c0b-56e1e9f54a9d", "id": 13}]=0 v16) ==== 113+0+3 (secure 0 0 0) 0x7f909404f2f0 con 0x7f90a411e1c0 2026-02-24T17:24:56.225 INFO:teuthology.orchestra.run.trial120.stdout:13 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 10 librados: watch_flush enter 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 10 librados: watch_flush exit 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 20 client.4214.objecter shutdown clearing up homeless session... 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 10 client.4214.objecter successfully canceled tick 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f90a411e1c0 msgr2=0x7f90a4107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f90a411e1c0 0x7f90a4107fe0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9094009430 tx=0x7f909400ee10 comp rx=0 tx=0).stop 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 shutdown_connections 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f90a4165ed0 0x7f90a410d820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90a411ead0 0x7f90a4108650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 --2- 10.20.193.120:0/1247496010 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f90a411e1c0 0x7f90a4107fe0 unknown :-1 s=CLOSED pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 >> 10.20.193.120:0/1247496010 conn(0x7f90a4059980 msgr2=0x7f90a4102970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 shutdown_connections 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 -- 10.20.193.120:0/1247496010 wait complete. 2026-02-24T17:24:56.226 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.221+0000 7f90ac3f2640 1 librados: shutdown 2026-02-24T17:24:56.234 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new a54b9053-910e-47f8-9f50-6366eb58ea0a 14 2026-02-24T17:24:56.295 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e5301a640 1 Processor -- start 2026-02-24T17:24:56.295 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e5301a640 1 -- start start 2026-02-24T17:24:56.295 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e5301a640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f7e4c05c6b0 0x7f7e4c122200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.295 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e5301a640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4c124550 con 0x7f7e4c05bbd0 2026-02-24T17:24:56.295 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e5301a640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4c124760 con 0x7f7e4c122830 2026-02-24T17:24:56.295 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e5301a640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4c18f3c0 con 0x7f7e4c05c6b0 2026-02-24T17:24:56.296 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e43fff640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f7e4c05c6b0 0x7f7e4c122200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.296 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e50d8f640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f7e4c05bbd0 0x7f7e4c05bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.120:51570/0 (socket says 10.20.193.120:51570) 2026-02-24T17:24:56.296 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.289+0000 7f7e50d8f640 1 -- 10.20.193.120:0/744128419 learned_addr learned my addr 10.20.193.120:0/744128419 (peer_addr_for_me v1:10.20.193.120:0/0) 2026-02-24T17:24:56.296 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e437fe640 1 -- 10.20.193.120:0/744128419 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362467968 0 0) 0x7f7e4c124550 con 0x7f7e4c05bbd0 2026-02-24T17:24:56.296 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e437fe640 1 -- 10.20.193.120:0/744128419 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e38003620 con 0x7f7e4c05bbd0 2026-02-24T17:24:56.296 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e43fff640 1 -- 10.20.193.120:0/744128419 >> v1:10.20.193.109:6789/0 conn(0x7f7e4c122830 legacy=0x7f7e4c122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.296 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e43fff640 1 -- 10.20.193.120:0/744128419 >> v1:10.20.193.40:6789/0 conn(0x7f7e4c05bbd0 legacy=0x7f7e4c05bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.296 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e43fff640 1 -- 10.20.193.120:0/744128419 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c18f590 con 0x7f7e4c05c6b0 2026-02-24T17:24:56.300 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e43fff640 1 --2- 10.20.193.120:0/744128419 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 0x7f7e4c122200 secure :-1 s=READY pgs=37 gs=3 cs=0 l=1 c_cookie=9285663414258666593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e34004780 tx=0x7f7e3401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80dd4dad7eba8c61 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.300 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e437fe640 1 -- 10.20.193.120:0/744128419 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e340ab680 con 0x7f7e4c05c6b0 2026-02-24T17:24:56.300 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e437fe640 1 -- 10.20.193.120:0/744128419 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e340b0070 con 0x7f7e4c05c6b0 2026-02-24T17:24:56.300 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e437fe640 1 -- 10.20.193.120:0/744128419 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e340aba40 con 0x7f7e4c05c6b0 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- 10.20.193.120:0/744128419 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 msgr2=0x7f7e4c122200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 --2- 10.20.193.120:0/744128419 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 0x7f7e4c122200 secure :-1 s=READY pgs=37 gs=3 cs=0 l=1 c_cookie=9285663414258666593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e34004780 tx=0x7f7e3401c440 comp rx=0 tx=0).stop 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- 10.20.193.120:0/744128419 shutdown_connections 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 --2- 10.20.193.120:0/744128419 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 0x7f7e4c122200 unknown :-1 s=CLOSED pgs=37 gs=3 cs=0 l=1 c_cookie=9285663414258666593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- 10.20.193.120:0/744128419 >> 10.20.193.120:0/744128419 conn(0x7f7e4c059980 msgr2=0x7f7e4c059d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- 10.20.193.120:0/744128419 shutdown_connections 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- 10.20.193.120:0/744128419 wait complete. 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 librados: starting msgr at 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 librados: starting objecter 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 Processor -- start 2026-02-24T17:24:56.301 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- start start 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 librados: setting wanted keys 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 librados: calling monclient init 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7e4c05bbd0 0x7f7e4c1336d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 0x7f7e4c133d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7e4c122830 0x7f7e4c138f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1908d0 con 0x7f7e4c05bbd0 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c190750 con 0x7f7e4c122830 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e5301a640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c190a50 con 0x7f7e4c05c6b0 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e50d8f640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7e4c05bbd0 0x7f7e4c1336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e43fff640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 0x7f7e4c133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e50d8f640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7e4c05bbd0 0x7f7e4c1336d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39750/0 (socket says 10.20.193.120:39750) 2026-02-24T17:24:56.302 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e51590640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7e4c122830 0x7f7e4c138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e50d8f640 1 -- 10.20.193.120:0/3161554255 learned_addr learned my addr 10.20.193.120:0/3161554255 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e51590640 1 -- 10.20.193.120:0/3161554255 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 msgr2=0x7f7e4c133d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e51590640 1 --2- 10.20.193.120:0/3161554255 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 0x7f7e4c133d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e51590640 1 -- 10.20.193.120:0/3161554255 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7e4c05bbd0 msgr2=0x7f7e4c1336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e51590640 1 --2- 10.20.193.120:0/3161554255 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7e4c05bbd0 0x7f7e4c1336d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e51590640 1 -- 10.20.193.120:0/3161554255 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c1397d0 con 0x7f7e4c122830 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e51590640 1 --2- 10.20.193.120:0/3161554255 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7e4c122830 0x7f7e4c138f10 secure :-1 s=READY pgs=36 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e48003c80 tx=0x7f7e4800dd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e417fa640 10 client.?.objecter ms_handle_connect 0x7f7e4c122830 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.293+0000 7f7e417fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 1 -- 10.20.193.120:0/3161554255 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e48017020 con 0x7f7e4c122830 2026-02-24T17:24:56.303 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 1 -- 10.20.193.120:0/3161554255 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4800ba40 con 0x7f7e4c122830 2026-02-24T17:24:56.304 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c139ac0 con 0x7f7e4c122830 2026-02-24T17:24:56.304 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 1 -- 10.20.193.120:0/3161554255 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e4800be10 con 0x7f7e4c122830 2026-02-24T17:24:56.304 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e5301a640 10 client.4216.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:56.304 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c17a330 con 0x7f7e4c122830 2026-02-24T17:24:56.304 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e5301a640 1 librados: init done 2026-02-24T17:24:56.304 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4c05bfa0 con 0x7f7e4c122830 2026-02-24T17:24:56.305 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 1 -- 10.20.193.120:0/3161554255 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7f7e48013420 con 0x7f7e4c122830 2026-02-24T17:24:56.305 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 1 -- 10.20.193.120:0/3161554255 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2330+0+0 (secure 0 0 0) 0x7f7e48051a40 con 0x7f7e4c122830 2026-02-24T17:24:56.305 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 10 client.4216.objecter ms_dispatch2 0x7f7e4c000ba0 osd_map(16..16 src has 1..16) 2026-02-24T17:24:56.305 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 3 client.4216.objecter handle_osd_map got epochs [16,16] > 0 2026-02-24T17:24:56.305 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 3 client.4216.objecter handle_osd_map decoding full epoch 16 2026-02-24T17:24:56.305 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 20 client.4216.objecter dump_active .. 0 homeless 2026-02-24T17:24:56.305 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.297+0000 7f7e417fa640 1 -- 10.20.193.120:0/3161554255 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7f7e48021020 con 0x7f7e4c122830 2026-02-24T17:24:56.336 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a54b9053-910e-47f8-9f50-6366eb58ea0a", "id": 14} v 0) -- 0x7f7e4c057410 con 0x7f7e4c122830 2026-02-24T17:24:56.338 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e417fa640 1 -- 10.20.193.120:0/3161554255 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a54b9053-910e-47f8-9f50-6366eb58ea0a", "id": 14}]=0 v17) ==== 113+0+3 (secure 0 0 0) 0x7f7e480201b0 con 0x7f7e4c122830 2026-02-24T17:24:56.339 INFO:teuthology.orchestra.run.trial120.stdout:14 2026-02-24T17:24:56.340 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 10 librados: watch_flush enter 2026-02-24T17:24:56.340 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 10 librados: watch_flush exit 2026-02-24T17:24:56.340 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 20 client.4216.objecter shutdown clearing up homeless session... 2026-02-24T17:24:56.340 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 10 client.4216.objecter successfully canceled tick 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7e4c122830 msgr2=0x7f7e4c138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 --2- 10.20.193.120:0/3161554255 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7e4c122830 0x7f7e4c138f10 secure :-1 s=READY pgs=36 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e48003c80 tx=0x7f7e4800dd60 comp rx=0 tx=0).stop 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 shutdown_connections 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 --2- 10.20.193.120:0/3161554255 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7e4c122830 0x7f7e4c138f10 unknown :-1 s=CLOSED pgs=36 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 --2- 10.20.193.120:0/3161554255 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7e4c05c6b0 0x7f7e4c133d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 --2- 10.20.193.120:0/3161554255 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7e4c05bbd0 0x7f7e4c1336d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 >> 10.20.193.120:0/3161554255 conn(0x7f7e4c059980 msgr2=0x7f7e4c11f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 shutdown_connections 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 -- 10.20.193.120:0/3161554255 wait complete. 2026-02-24T17:24:56.341 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.333+0000 7f7e5301a640 1 librados: shutdown 2026-02-24T17:24:56.349 DEBUG:teuthology.orchestra.run.trial120:> sudo ceph --cluster ceph osd new d208141f-10d4-45e4-938a-3971dcc08dd3 15 2026-02-24T17:24:56.409 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.401+0000 7fcfc0674640 1 Processor -- start 2026-02-24T17:24:56.409 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- start start 2026-02-24T17:24:56.409 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fcfb811e1c0 0x7fcfb811e590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.409 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fcfb811ead0 0x7fcfb8165990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb81879d0 con 0x7fcfb8165ed0 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb8188bb0 con 0x7fcfb811e1c0 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb8188d30 con 0x7fcfb811ead0 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbe3e9640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fcfb811e1c0 0x7fcfb811e590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fcfb811ead0 0x7fcfb8165990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbe3e9640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fcfb811e1c0 0x7fcfb811e590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39754/0 (socket says 10.20.193.120:39754) 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fcfb811ead0 0x7fcfb8165990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50704/0 (socket says 10.20.193.120:50704) 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbe3e9640 1 -- 10.20.193.120:0/3130724024 learned_addr learned my addr 10.20.193.120:0/3130724024 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbebea640 1 --1- 10.20.193.120:0/3130724024 >> v1:10.20.193.40:6789/0 conn(0x7fcfb8165ed0 0x7fcfb81862b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.120:51576/0 (socket says 10.20.193.120:51576) 2026-02-24T17:24:56.410 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 -- 10.20.193.120:0/3130724024 >> v2:10.20.193.40:3300/0 conn(0x7fcfb811e1c0 msgr2=0x7fcfb811e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:56.411 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 --2- 10.20.193.120:0/3130724024 >> v2:10.20.193.40:3300/0 conn(0x7fcfb811e1c0 0x7fcfb811e590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.411 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 -- 10.20.193.120:0/3130724024 >> v1:10.20.193.40:6789/0 conn(0x7fcfb8165ed0 legacy=0x7fcfb81862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.411 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbd3e7640 1 -- 10.20.193.120:0/3130724024 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699809912 0 0) 0x7fcfb81879d0 con 0x7fcfb8165ed0 2026-02-24T17:24:56.411 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 -- 10.20.193.120:0/3130724024 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb8188eb0 con 0x7fcfb811ead0 2026-02-24T17:24:56.415 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 --2- 10.20.193.120:0/3130724024 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8165990 secure :-1 s=READY pgs=37 gs=3 cs=0 l=1 c_cookie=11548687434486143371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb8120240 tx=0x7fcfac01c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0452e08ba90598b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.415 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbd3e7640 1 -- 10.20.193.120:0/3130724024 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfac0ab640 con 0x7fcfb811ead0 2026-02-24T17:24:56.415 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbd3e7640 1 -- 10.20.193.120:0/3130724024 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac0b0070 con 0x7fcfb811ead0 2026-02-24T17:24:56.416 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbd3e7640 1 -- 10.20.193.120:0/3130724024 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfac0aba20 con 0x7fcfb811ead0 2026-02-24T17:24:56.416 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- 10.20.193.120:0/3130724024 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 msgr2=0x7fcfb8165990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.416 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 --2- 10.20.193.120:0/3130724024 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8165990 secure :-1 s=READY pgs=37 gs=3 cs=0 l=1 c_cookie=11548687434486143371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb8120240 tx=0x7fcfac01c400 comp rx=0 tx=0).stop 2026-02-24T17:24:56.416 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- 10.20.193.120:0/3130724024 shutdown_connections 2026-02-24T17:24:56.416 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 --2- 10.20.193.120:0/3130724024 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8165990 unknown :-1 s=CLOSED pgs=37 gs=3 cs=0 l=1 c_cookie=11548687434486143371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.416 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 --2- 10.20.193.120:0/3130724024 >> v2:10.20.193.40:3300/0 conn(0x7fcfb811e1c0 0x7fcfb811e590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.417 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- 10.20.193.120:0/3130724024 >> 10.20.193.120:0/3130724024 conn(0x7fcfb8059980 msgr2=0x7fcfb8059d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.417 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- 10.20.193.120:0/3130724024 shutdown_connections 2026-02-24T17:24:56.417 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- 10.20.193.120:0/3130724024 wait complete. 2026-02-24T17:24:56.417 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 librados: starting msgr at 2026-02-24T17:24:56.417 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 librados: starting objecter 2026-02-24T17:24:56.417 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 Processor -- start 2026-02-24T17:24:56.418 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- start start 2026-02-24T17:24:56.418 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 librados: setting wanted keys 2026-02-24T17:24:56.418 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 librados: calling monclient init 2026-02-24T17:24:56.418 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfb811e1c0 0x7fcfb8106bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.418 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8107260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.418 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfb8165ed0 0x7fcfb810c430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.419 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb8188830 con 0x7fcfb811e1c0 2026-02-24T17:24:56.419 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb81886b0 con 0x7fcfb811ead0 2026-02-24T17:24:56.419 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfc0674640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb81889b0 con 0x7fcfb8165ed0 2026-02-24T17:24:56.419 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbe3e9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfb811e1c0 0x7fcfb8106bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.419 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8107260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.419 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8107260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:50710/0 (socket says 10.20.193.120:50710) 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbdbe8640 1 -- 10.20.193.120:0/3369431228 learned_addr learned my addr 10.20.193.120:0/3369431228 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbe3e9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfb811e1c0 0x7fcfb8106bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.120:39762/0 (socket says 10.20.193.120:39762) 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.405+0000 7fcfbebea640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfb8165ed0 0x7fcfb810c430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfbdbe8640 1 -- 10.20.193.120:0/3369431228 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfb8165ed0 msgr2=0x7fcfb810c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfbdbe8640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfb8165ed0 0x7fcfb810c430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfbdbe8640 1 -- 10.20.193.120:0/3369431228 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfb811e1c0 msgr2=0x7fcfb8106bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfbdbe8640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfb811e1c0 0x7fcfb8106bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfbdbe8640 1 -- 10.20.193.120:0/3369431228 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb810ccf0 con 0x7fcfb811ead0 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfbe3e9640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfb811e1c0 0x7fcfb8106bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:24:56.420 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfbdbe8640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8107260 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfac01c970 tx=0x7fcfac0191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.421 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 10 client.?.objecter ms_handle_connect 0x7fcfb811ead0 2026-02-24T17:24:56.421 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:56.421 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 1 -- 10.20.193.120:0/3369431228 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfac003d00 con 0x7fcfb811ead0 2026-02-24T17:24:56.421 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 1 -- 10.20.193.120:0/3369431228 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac0ba070 con 0x7fcfb811ead0 2026-02-24T17:24:56.421 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 1 -- 10.20.193.120:0/3369431228 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfac0ab660 con 0x7fcfb811ead0 2026-02-24T17:24:56.421 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb810cf80 con 0x7fcfb811ead0 2026-02-24T17:24:56.421 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfc0674640 10 client.4222.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb8164bd0 con 0x7fcfb811ead0 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfc0674640 1 librados: init done 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb811e590 con 0x7fcfb811ead0 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 1 -- 10.20.193.120:0/3369431228 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7fcfac0ab800 con 0x7fcfb811ead0 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 1 -- 10.20.193.120:0/3369431228 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2445+0+0 (secure 0 0 0) 0x7fcfac0ea600 con 0x7fcfb811ead0 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 10 client.4222.objecter ms_dispatch2 0x7fcfb8000ba0 osd_map(17..17 src has 1..17) 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 3 client.4222.objecter handle_osd_map got epochs [17,17] > 0 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 3 client.4222.objecter handle_osd_map decoding full epoch 17 2026-02-24T17:24:56.422 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 20 client.4222.objecter dump_active .. 0 homeless 2026-02-24T17:24:56.423 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.409+0000 7fcf9effd640 1 -- 10.20.193.120:0/3369431228 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7fcfac016110 con 0x7fcfb811ead0 2026-02-24T17:24:56.449 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.445+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d208141f-10d4-45e4-938a-3971dcc08dd3", "id": 15} v 0) -- 0x7fcfb8057410 con 0x7fcfb811ead0 2026-02-24T17:24:56.451 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.445+0000 7fcf9effd640 1 -- 10.20.193.120:0/3369431228 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d208141f-10d4-45e4-938a-3971dcc08dd3", "id": 15}]=0 v18) ==== 113+0+3 (secure 0 0 0) 0x7fcfac0b9e20 con 0x7fcfb811ead0 2026-02-24T17:24:56.451 INFO:teuthology.orchestra.run.trial120.stdout:15 2026-02-24T17:24:56.453 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.445+0000 7fcfc0674640 10 librados: watch_flush enter 2026-02-24T17:24:56.453 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.445+0000 7fcfc0674640 10 librados: watch_flush exit 2026-02-24T17:24:56.453 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.445+0000 7fcfc0674640 20 client.4222.objecter shutdown clearing up homeless session... 2026-02-24T17:24:56.453 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.445+0000 7fcfc0674640 10 client.4222.objecter successfully canceled tick 2026-02-24T17:24:56.453 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.445+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 msgr2=0x7fcfb8107260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.453 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.445+0000 7fcfc0674640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8107260 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfac01c970 tx=0x7fcfac0191a0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.453 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.449+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 shutdown_connections 2026-02-24T17:24:56.453 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.449+0000 7fcfc0674640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfb8165ed0 0x7fcfb810c430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.454 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.449+0000 7fcfc0674640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfb811ead0 0x7fcfb8107260 unknown :-1 s=CLOSED pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.454 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.449+0000 7fcfc0674640 1 --2- 10.20.193.120:0/3369431228 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfb811e1c0 0x7fcfb8106bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.454 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.449+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 >> 10.20.193.120:0/3369431228 conn(0x7fcfb8059980 msgr2=0x7fcfb8102940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.454 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.449+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 shutdown_connections 2026-02-24T17:24:56.454 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.449+0000 7fcfc0674640 1 -- 10.20.193.120:0/3369431228 wait complete. 2026-02-24T17:24:56.454 INFO:teuthology.orchestra.run.trial120.stderr:2026-02-24T17:24:56.449+0000 7fcfc0674640 1 librados: shutdown 2026-02-24T17:24:56.464 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-24T17:24:56.464 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-24T17:24:56.467 INFO:tasks.ceph.osd.0:Started 2026-02-24T17:24:56.467 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-24T17:24:56.467 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-24T17:24:56.470 INFO:tasks.ceph.osd.4:Started 2026-02-24T17:24:56.471 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-24T17:24:56.471 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2026-02-24T17:24:56.474 INFO:tasks.ceph.osd.8:Started 2026-02-24T17:24:56.474 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-24T17:24:56.474 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 12 2026-02-24T17:24:56.477 INFO:tasks.ceph.osd.12:Started 2026-02-24T17:24:56.478 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-24T17:24:56.478 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-24T17:24:56.481 INFO:tasks.ceph.osd.1:Started 2026-02-24T17:24:56.481 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-24T17:24:56.481 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-24T17:24:56.484 INFO:tasks.ceph.osd.5:Started 2026-02-24T17:24:56.484 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-24T17:24:56.484 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2026-02-24T17:24:56.486 INFO:tasks.ceph.osd.9:Started 2026-02-24T17:24:56.486 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-24T17:24:56.487 DEBUG:teuthology.orchestra.run.trial094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 13 2026-02-24T17:24:56.488 INFO:tasks.ceph.osd.13:Started 2026-02-24T17:24:56.488 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-24T17:24:56.489 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-24T17:24:56.491 INFO:tasks.ceph.osd.2:Started 2026-02-24T17:24:56.491 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-24T17:24:56.491 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-24T17:24:56.493 INFO:tasks.ceph.osd.6:Started 2026-02-24T17:24:56.493 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-24T17:24:56.494 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2026-02-24T17:24:56.496 INFO:tasks.ceph.osd.10:Started 2026-02-24T17:24:56.496 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-24T17:24:56.496 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 14 2026-02-24T17:24:56.498 INFO:tasks.ceph.osd.14:Started 2026-02-24T17:24:56.498 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-24T17:24:56.498 DEBUG:teuthology.orchestra.run.trial120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-24T17:24:56.500 INFO:tasks.ceph.osd.3:Started 2026-02-24T17:24:56.500 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-24T17:24:56.500 DEBUG:teuthology.orchestra.run.trial120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-24T17:24:56.501 INFO:tasks.ceph.osd.7:Started 2026-02-24T17:24:56.501 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-24T17:24:56.501 DEBUG:teuthology.orchestra.run.trial120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2026-02-24T17:24:56.502 INFO:tasks.ceph.osd.11:Started 2026-02-24T17:24:56.502 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-24T17:24:56.502 DEBUG:teuthology.orchestra.run.trial120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 15 2026-02-24T17:24:56.503 INFO:tasks.ceph.osd.15:Started 2026-02-24T17:24:56.503 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T17:24:56.565 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.552+0000 7fecc442e640 1 Processor -- start 2026-02-24T17:24:56.565 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.552+0000 7fecc442e640 1 -- start start 2026-02-24T17:24:56.565 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fecbc05d570 0x7fecbc0b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.565 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecbc1673c0 con 0x7fecbc05d1a0 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecbc1676a0 con 0x7fecbc16ada0 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fecbc167980 con 0x7fecbc05d570 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc21a3640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fecbc05d1a0 0x7fecbc166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:41668/0 (socket says 10.20.193.40:41668) 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc21a3640 1 -- 10.20.193.40:0/1958963730 learned_addr learned my addr 10.20.193.40:0/1958963730 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372106933 0 0) 0x7fecbc1673c0 con 0x7fecbc05d1a0 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 --2- 10.20.193.40:0/1958963730 >> v2:10.20.193.94:3300/0 conn(0x7fecbc05d570 0x7fecbc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feca4003620 con 0x7fecbc05d1a0 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1409420513 0 0) 0x7feca4003620 con 0x7fecbc05d1a0 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 >> v2:10.20.193.94:3300/0 conn(0x7fecbc05d570 msgr2=0x7fecbc0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 --2- 10.20.193.40:0/1958963730 >> v2:10.20.193.94:3300/0 conn(0x7fecbc05d570 0x7fecbc0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 >> v1:10.20.193.94:6789/0 conn(0x7fecbc16ada0 legacy=0x7fecbc0bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecbc0b4430 con 0x7fecbc05d1a0 2026-02-24T17:24:56.566 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7fecac002e80 con 0x7fecbc05d1a0 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 >> v1:10.20.193.40:6789/0 conn(0x7fecbc05d1a0 legacy=0x7fecbc166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7feca4003bf0 0x7feca4004000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7feca40048d0 0x7feca4004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7feca4065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc167980 con 0x7feca40053a0 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7feca40662d0 con 0x7feca40048d0 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7feca40664d0 con 0x7feca4003bf0 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7feca4065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc21a3640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7feca4003bf0 0x7feca4004000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc19a2640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7feca40048d0 0x7feca4004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 -- 10.20.193.40:0/1958963730 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7feca4003bf0 msgr2=0x7feca4004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7feca4003bf0 0x7feca4004000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 -- 10.20.193.40:0/1958963730 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7feca40048d0 msgr2=0x7feca4004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:56.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7feca40048d0 0x7feca4004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 -- 10.20.193.40:0/1958963730 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca4003620 con 0x7feca40053a0 2026-02-24T17:24:56.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 -- 10.20.193.40:0/1958963730 reap_dead start 2026-02-24T17:24:56.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc29a4640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7feca4065a90 secure :-1 s=READY pgs=59 gs=5 cs=0 l=1 c_cookie=6252541009184685613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb800aeb0 tx=0x7fecb801dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c57ceba403fe2d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecb800ab80 con 0x7feca40053a0 2026-02-24T17:24:56.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb80a6c60 con 0x7feca40053a0 2026-02-24T17:24:56.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc11a1640 1 -- 10.20.193.40:0/1958963730 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecb80ae690 con 0x7feca40053a0 2026-02-24T17:24:56.571 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 -- 10.20.193.40:0/1958963730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 msgr2=0x7feca4065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7feca4065a90 secure :-1 s=READY pgs=59 gs=5 cs=0 l=1 c_cookie=6252541009184685613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb800aeb0 tx=0x7fecb801dc40 comp rx=0 tx=0).stop 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 -- 10.20.193.40:0/1958963730 shutdown_connections 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 --2- 10.20.193.40:0/1958963730 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7feca4065a90 unknown :-1 s=CLOSED pgs=59 gs=5 cs=0 l=1 c_cookie=6252541009184685613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 -- 10.20.193.40:0/1958963730 >> 10.20.193.40:0/1958963730 conn(0x7fecbc0bd200 msgr2=0x7fecbc0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 -- 10.20.193.40:0/1958963730 shutdown_connections 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.556+0000 7fecc442e640 1 -- 10.20.193.40:0/1958963730 wait complete. 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 librados: starting msgr at 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 librados: starting objecter 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 Processor -- start 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 -- start start 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 librados: setting wanted keys 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 librados: calling monclient init 2026-02-24T17:24:56.572 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7fecbc1488d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fecbc138070 0x7fecbc15bf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fecbc169870 0x7fecbc15c4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc0b49f0 con 0x7feca40053a0 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc05d940 con 0x7fecbc169870 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fecbc166bf0 con 0x7fecbc138070 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7fecbc1488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7fecbc1488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:55972/0 (socket says 10.20.193.40:55972) 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 -- 10.20.193.40:0/3344070324 learned_addr learned my addr 10.20.193.40:0/3344070324 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc29a4640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fecbc169870 0x7fecbc15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc19a2640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fecbc138070 0x7fecbc15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 -- 10.20.193.40:0/3344070324 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fecbc138070 msgr2=0x7fecbc15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fecbc138070 0x7fecbc15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.573 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 -- 10.20.193.40:0/3344070324 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fecbc169870 msgr2=0x7fecbc15c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fecbc169870 0x7fecbc15c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 -- 10.20.193.40:0/3344070324 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecbc138560 con 0x7feca40053a0 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc21a3640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7fecbc1488d0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecac007310 tx=0x7fecac0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 10 client.?.objecter ms_handle_connect 0x7feca40053a0 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 1 -- 10.20.193.40:0/3344070324 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecac00fbe0 con 0x7feca40053a0 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 1 -- 10.20.193.40:0/3344070324 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecac018070 con 0x7feca40053a0 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecbc138840 con 0x7feca40053a0 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 1 -- 10.20.193.40:0/3344070324 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecac0133f0 con 0x7feca40053a0 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 10 client.4290.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecbc138e00 con 0x7feca40053a0 2026-02-24T17:24:56.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 librados: init done 2026-02-24T17:24:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecbc166f80 con 0x7feca40053a0 2026-02-24T17:24:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 1 -- 10.20.193.40:0/3344070324 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 2) ==== 50154+0+0 (secure 0 0 0) 0x7fecac013590 con 0x7feca40053a0 2026-02-24T17:24:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 1 -- 10.20.193.40:0/3344070324 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (secure 0 0 0) 0x7fecac010040 con 0x7feca40053a0 2026-02-24T17:24:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 10 client.4290.objecter ms_dispatch2 0x7fecbc000ba0 osd_map(18..18 src has 1..18) 2026-02-24T17:24:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 3 client.4290.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T17:24:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 3 client.4290.objecter handle_osd_map decoding full epoch 18 2026-02-24T17:24:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 20 client.4290.objecter dump_active .. 0 homeless 2026-02-24T17:24:56.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.560+0000 7feca2ffd640 1 -- 10.20.193.40:0/3344070324 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+79251 (secure 0 0 0) 0x7fecac01d460 con 0x7feca40053a0 2026-02-24T17:24:56.599 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecbc0b8520 con 0x7feca40053a0 2026-02-24T17:24:56.600 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7feca2ffd640 1 -- 10.20.193.40:0/3344070324 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (secure 0 0 0) 0x7fecac013c40 con 0x7feca40053a0 2026-02-24T17:24:56.600 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:24:56.601 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":18,"fsid":"f24f61d3-eddb-4c62-878a-4823ddf02ae6","created":"2026-02-24T17:24:53.565540+0000","modified":"2026-02-24T17:24:56.443925+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T17:24:56.443925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a63c8bf5-8276-4498-bfa8-84f1c5088edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8145c280-0f0a-4c92-8026-76099c124e29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c2f26f49-f93a-43e9-b17b-871ec271af4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"29f34fbd-eed3-4f11-8368-c83f4c080816","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"39b6c845-a7fd-440b-9d84-1969c6236693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ca53011f-6445-46ff-bee3-5ac8c76d24f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c4862062-f74a-4802-be50-4ac14c0f40f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"ecbb5459-70a3-4d39-910c-27e89ee16ef6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c08fc40c-17cc-44e9-9250-afa1539de8c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"222e48db-8734-4e1b-885d-90de04f44ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"c1ccd78b-db99-4911-8140-67f0af870949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"4c58eff7-882b-4bfd-9816-137d0e3ed5a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e1c78-dbc4-4789-9c0b-56e1e9f54a9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"a54b9053-910e-47f8-9f50-6366eb58ea0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"d208141f-10d4-45e4-938a-3971dcc08dd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T17:24:56.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 10 librados: watch_flush enter 2026-02-24T17:24:56.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 10 librados: watch_flush exit 2026-02-24T17:24:56.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 20 client.4290.objecter shutdown clearing up homeless session... 2026-02-24T17:24:56.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 10 client.4290.objecter successfully canceled tick 2026-02-24T17:24:56.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 msgr2=0x7fecbc1488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:56.602 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7fecbc1488d0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecac007310 tx=0x7fecac0077d0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 shutdown_connections 2026-02-24T17:24:56.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fecbc169870 0x7fecbc15c4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fecbc138070 0x7fecbc15bf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 --2- 10.20.193.40:0/3344070324 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7feca40053a0 0x7fecbc1488d0 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:56.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 >> 10.20.193.40:0/3344070324 conn(0x7fecbc0bd200 msgr2=0x7fecbc0b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:56.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 shutdown_connections 2026-02-24T17:24:56.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 -- 10.20.193.40:0/3344070324 wait complete. 2026-02-24T17:24:56.603 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:24:56.592+0000 7fecc442e640 1 librados: shutdown 2026-02-24T17:24:56.611 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-24T17:24:56.611 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-24T17:24:56.868 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:24:56.868+0000 7fb6bd24fa40 -1 Falling back to public interface 2026-02-24T17:24:56.868 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:24:56.868+0000 7f4de036da40 -1 Falling back to public interface 2026-02-24T17:24:56.869 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:24:56.868+0000 7f4ddf32d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2026-02-24T17:24:56.884 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:24:56.881+0000 7fd23b8afa40 -1 Falling back to public interface 2026-02-24T17:24:56.887 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:24:56.888+0000 7f72ecd8aa40 -1 Falling back to public interface 2026-02-24T17:24:56.887 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:24:56.888+0000 7fce712eea40 -1 Falling back to public interface 2026-02-24T17:24:56.896 INFO:tasks.ceph.mgr.x.trial120.stderr:2026-02-24T17:24:56.893+0000 7f5d4fe21640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-24T17:24:56.898 INFO:tasks.ceph.mgr.x.trial120.stderr:2026-02-24T17:24:56.893+0000 7f5d4fe21640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-24T17:24:56.900 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:24:56.897+0000 7f9d0de7ca40 -1 Falling back to public interface 2026-02-24T17:24:56.901 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:24:56.897+0000 7f9b79125a40 -1 Falling back to public interface 2026-02-24T17:24:56.924 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:24:56.921+0000 7f09c5c5fa40 -1 Falling back to public interface 2026-02-24T17:24:56.943 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:24:56.944+0000 7fed3fe6ba40 -1 Falling back to public interface 2026-02-24T17:24:56.959 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:24:56.960+0000 7fb7e0288a40 -1 Falling back to public interface 2026-02-24T17:24:56.963 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:24:56.964+0000 7f1f60092a40 -1 Falling back to public interface 2026-02-24T17:24:56.972 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:24:56.964+0000 7fe824887a40 -1 Falling back to public interface 2026-02-24T17:24:56.984 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:24:56.976+0000 7f5998a5da40 -1 Falling back to public interface 2026-02-24T17:24:56.996 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:24:56.988+0000 7ff6732f2a40 -1 Falling back to public interface 2026-02-24T17:24:57.008 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:24:57.000+0000 7fbbb9fbda40 -1 Falling back to public interface 2026-02-24T17:24:57.179 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:24:57.180+0000 7f8fd4c60a40 -1 Falling back to public interface 2026-02-24T17:24:57.859 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:24:57.853+0000 7fd23b8afa40 -1 osd.11 0 log_to_monitors true 2026-02-24T17:24:57.871 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:24:57.872+0000 7f4de036da40 -1 osd.14 0 log_to_monitors true 2026-02-24T17:24:57.872 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:24:57.872+0000 7fce712eea40 -1 osd.6 0 log_to_monitors true 2026-02-24T17:24:57.872 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:24:57.872+0000 7f72ecd8aa40 -1 osd.10 0 log_to_monitors true 2026-02-24T17:24:57.885 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:24:57.884+0000 7fb6bd24fa40 -1 osd.2 0 log_to_monitors true 2026-02-24T17:24:57.908 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:24:57.905+0000 7f9b79125a40 -1 osd.15 0 log_to_monitors true 2026-02-24T17:24:57.920 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:24:57.917+0000 7f9d0de7ca40 -1 osd.3 0 log_to_monitors true 2026-02-24T17:24:57.920 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:24:57.917+0000 7f09c5c5fa40 -1 osd.7 0 log_to_monitors true 2026-02-24T17:24:57.971 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:24:57.959+0000 7ff6732f2a40 -1 osd.8 0 log_to_monitors true 2026-02-24T17:24:57.992 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:24:57.983+0000 7fe824887a40 -1 osd.4 0 log_to_monitors true 2026-02-24T17:24:58.013 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:24:58.003+0000 7f5998a5da40 -1 osd.0 0 log_to_monitors true 2026-02-24T17:24:58.014 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:24:58.003+0000 7fbbb9fbda40 -1 osd.12 0 log_to_monitors true 2026-02-24T17:24:58.060 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:24:58.060+0000 7f1f60092a40 -1 osd.1 0 log_to_monitors true 2026-02-24T17:24:58.079 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:24:58.080+0000 7fb7e0288a40 -1 osd.5 0 log_to_monitors true 2026-02-24T17:24:58.104 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:24:58.104+0000 7fed3fe6ba40 -1 osd.9 0 log_to_monitors true 2026-02-24T17:24:58.222 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T17:24:58.278 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb720b78640 1 Processor -- start 2026-02-24T17:24:58.278 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb720b78640 1 -- start start 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb720b78640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fb71c15d0b0 0x7fb71c1668b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb720b78640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fb71c15d480 0x7fb71c0b4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb720b78640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb71c0b5430 con 0x7fb71c0b4ff0 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb720b78640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb71c166df0 con 0x7fb71c15d480 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb720b78640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fb71c167010 con 0x7fb71c15d0b0 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb71bfff640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fb71c0b4ff0 0x7fb71c05d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:41674/0 (socket says 10.20.193.40:41674) 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb71bfff640 1 -- 10.20.193.40:0/1479354511 learned_addr learned my addr 10.20.193.40:0/1479354511 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb71affd640 1 --2- 10.20.193.40:0/1479354511 >> v2:10.20.193.94:3300/0 conn(0x7fb71c15d480 0x7fb71c0b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.267+0000 7fb71b7fe640 1 --2- 10.20.193.40:0/1479354511 >> v2:10.20.193.109:3300/0 conn(0x7fb71c15d0b0 0x7fb71c1668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154103861 0 0) 0x7fb71c0b5430 con 0x7fb71c0b4ff0 2026-02-24T17:24:58.279 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb700003620 con 0x7fb71c0b4ff0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 306048207 0 0) 0x7fb700003620 con 0x7fb71c0b4ff0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 >> v2:10.20.193.109:3300/0 conn(0x7fb71c15d0b0 msgr2=0x7fb71c1668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 --2- 10.20.193.40:0/1479354511 >> v2:10.20.193.109:3300/0 conn(0x7fb71c15d0b0 0x7fb71c1668b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 >> v2:10.20.193.94:3300/0 conn(0x7fb71c15d480 msgr2=0x7fb71c0b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 --2- 10.20.193.40:0/1479354511 >> v2:10.20.193.94:3300/0 conn(0x7fb71c15d480 0x7fb71c0b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c1672f0 con 0x7fb71c0b4ff0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7fb710004390 con 0x7fb71c0b4ff0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 >> v1:10.20.193.40:6789/0 conn(0x7fb71c0b4ff0 legacy=0x7fb71c05d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700003ba0 0x7fb700003fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb7000048d0 0x7fb700004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb700005280 0x7fb700065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c166df0 con 0x7fb700005280 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c167010 con 0x7fb7000048d0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb700066290 con 0x7fb700003ba0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71b7fe640 1 --2- 10.20.193.40:0/1479354511 >> v2:10.20.193.109:3300/0 conn(0x7fb71c15d0b0 0x7fb71c1668b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71bfff640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb700005280 0x7fb700065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71affd640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb7000048d0 0x7fb700004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71b7fe640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700003ba0 0x7fb700003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71bfff640 1 -- 10.20.193.40:0/1479354511 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700003ba0 msgr2=0x7fb700003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71bfff640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700003ba0 0x7fb700003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71bfff640 1 -- 10.20.193.40:0/1479354511 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb7000048d0 msgr2=0x7fb700004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71bfff640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb7000048d0 0x7fb700004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71bfff640 1 -- 10.20.193.40:0/1479354511 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb700003620 con 0x7fb700005280 2026-02-24T17:24:58.280 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71affd640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb7000048d0 0x7fb700004d40 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:24:58.281 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71bfff640 1 -- 10.20.193.40:0/1479354511 reap_dead start 2026-02-24T17:24:58.281 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71bfff640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb700005280 0x7fb700065a90 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=7090129781984409473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb710004780 tx=0x7fb710020980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62653378ba993781 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:58.281 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb71000b3b0 con 0x7fb700005280 2026-02-24T17:24:58.281 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7100ae6b0 con 0x7fb700005280 2026-02-24T17:24:58.281 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb71a7fc640 1 -- 10.20.193.40:0/1479354511 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7100aeac0 con 0x7fb700005280 2026-02-24T17:24:58.282 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb720b78640 1 -- 10.20.193.40:0/1479354511 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb700005280 msgr2=0x7fb700065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:58.282 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb720b78640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb700005280 0x7fb700065a90 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=7090129781984409473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb710004780 tx=0x7fb710020980 comp rx=0 tx=0).stop 2026-02-24T17:24:58.282 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb720b78640 1 -- 10.20.193.40:0/1479354511 shutdown_connections 2026-02-24T17:24:58.282 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb720b78640 1 --2- 10.20.193.40:0/1479354511 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb700005280 0x7fb700065a90 unknown :-1 s=CLOSED pgs=68 gs=4 cs=0 l=1 c_cookie=7090129781984409473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.282 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb720b78640 1 -- 10.20.193.40:0/1479354511 >> 10.20.193.40:0/1479354511 conn(0x7fb71c0b99b0 msgr2=0x7fb71c0b9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:58.282 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb720b78640 1 -- 10.20.193.40:0/1479354511 shutdown_connections 2026-02-24T17:24:58.282 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.271+0000 7fb720b78640 1 -- 10.20.193.40:0/1479354511 wait complete. 2026-02-24T17:24:58.282 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:24:58.284+0000 7f8fd4c60a40 -1 osd.13 0 log_to_monitors true 2026-02-24T17:24:58.283 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 librados: starting msgr at 2026-02-24T17:24:58.283 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 librados: starting objecter 2026-02-24T17:24:58.283 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 Processor -- start 2026-02-24T17:24:58.283 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 -- start start 2026-02-24T17:24:58.283 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 librados: setting wanted keys 2026-02-24T17:24:58.283 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 librados: calling monclient init 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700005280 0x7fb71c139930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb71c13b1a0 0x7fb71c1646b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb71c164bf0 0x7fb71c1202e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c0b4590 con 0x7fb71c164bf0 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c0b42b0 con 0x7fb71c13b1a0 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c1668b0 con 0x7fb700005280 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb71c164bf0 0x7fb71c1202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb71c164bf0 0x7fb71c1202e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:56016/0 (socket says 10.20.193.40:56016) 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 -- 10.20.193.40:0/743794534 learned_addr learned my addr 10.20.193.40:0/743794534 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71affd640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb71c13b1a0 0x7fb71c1646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71b7fe640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700005280 0x7fb71c139930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.284 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 -- 10.20.193.40:0/743794534 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700005280 msgr2=0x7fb71c139930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700005280 0x7fb71c139930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 -- 10.20.193.40:0/743794534 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb71c13b1a0 msgr2=0x7fb71c1646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb71c13b1a0 0x7fb71c1646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 -- 10.20.193.40:0/743794534 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c1651a0 con 0x7fb71c164bf0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71bfff640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb71c164bf0 0x7fb71c1202e0 secure :-1 s=READY pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb710003920 tx=0x7fb700005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 10 client.?.objecter ms_handle_connect 0x7fb71c164bf0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 1 -- 10.20.193.40:0/743794534 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7100be070 con 0x7fb71c164bf0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 1 -- 10.20.193.40:0/743794534 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7100049a0 con 0x7fb71c164bf0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 1 -- 10.20.193.40:0/743794534 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7100aeaa0 con 0x7fb71c164bf0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71c165480 con 0x7fb71c164bf0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 10 client.4341.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb71c165a40 con 0x7fb71c164bf0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 librados: init done 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb71c13b570 con 0x7fb71c164bf0 2026-02-24T17:24:58.285 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 1 -- 10.20.193.40:0/743794534 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 3) ==== 99889+0+0 (secure 0 0 0) 0x7fb7100aec40 con 0x7fb71c164bf0 2026-02-24T17:24:58.286 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 1 --2- 10.20.193.40:0/743794534 >> v2:10.20.193.120:6800/397309233 conn(0x7fb6ec073f40 0x7fb6ec0943f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:24:58.286 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 1 -- 10.20.193.40:0/743794534 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (secure 0 0 0) 0x7fb710133160 con 0x7fb71c164bf0 2026-02-24T17:24:58.286 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 10 client.4341.objecter ms_dispatch2 0x7fb71c000ba0 osd_map(18..18 src has 1..18) 2026-02-24T17:24:58.287 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 3 client.4341.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T17:24:58.287 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 3 client.4341.objecter handle_osd_map decoding full epoch 18 2026-02-24T17:24:58.287 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb6f7fff640 20 client.4341.objecter dump_active .. 0 homeless 2026-02-24T17:24:58.287 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.275+0000 7fb71b7fe640 1 --2- 10.20.193.40:0/743794534 >> v2:10.20.193.120:6800/397309233 conn(0x7fb6ec073f40 0x7fb6ec0943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:24:58.287 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.279+0000 7fb71b7fe640 1 --2- 10.20.193.40:0/743794534 >> v2:10.20.193.120:6800/397309233 conn(0x7fb6ec073f40 0x7fb6ec0943f0 secure :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb708004780 tx=0x7fb708008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:24:58.287 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.279+0000 7fb6f7fff640 10 client.4341.objecter ms_handle_connect 0x7fb6ec073f40 2026-02-24T17:24:58.289 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.279+0000 7fb6f7fff640 1 -- 10.20.193.40:0/743794534 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fb7100c7070 con 0x7fb71c164bf0 2026-02-24T17:24:58.374 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.363+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb71c0b53f0 con 0x7fb71c164bf0 2026-02-24T17:24:58.375 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.363+0000 7fb6f7fff640 1 -- 10.20.193.40:0/743794534 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (secure 0 0 0) 0x7fb71001a730 con 0x7fb71c164bf0 2026-02-24T17:24:58.375 INFO:teuthology.misc.health.trial040.stdout: 2026-02-24T17:24:58.375 INFO:teuthology.misc.health.trial040.stdout:{"epoch":18,"fsid":"f24f61d3-eddb-4c62-878a-4823ddf02ae6","created":"2026-02-24T17:24:53.565540+0000","modified":"2026-02-24T17:24:56.443925+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T17:24:56.443925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a63c8bf5-8276-4498-bfa8-84f1c5088edb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8145c280-0f0a-4c92-8026-76099c124e29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c2f26f49-f93a-43e9-b17b-871ec271af4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"29f34fbd-eed3-4f11-8368-c83f4c080816","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"39b6c845-a7fd-440b-9d84-1969c6236693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ca53011f-6445-46ff-bee3-5ac8c76d24f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c4862062-f74a-4802-be50-4ac14c0f40f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"ecbb5459-70a3-4d39-910c-27e89ee16ef6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c08fc40c-17cc-44e9-9250-afa1539de8c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"222e48db-8734-4e1b-885d-90de04f44ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"c1ccd78b-db99-4911-8140-67f0af870949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"4c58eff7-882b-4bfd-9816-137d0e3ed5a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e1c78-dbc4-4789-9c0b-56e1e9f54a9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"a54b9053-910e-47f8-9f50-6366eb58ea0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"d208141f-10d4-45e4-938a-3971dcc08dd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T17:24:58.376 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 10 librados: watch_flush enter 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 10 librados: watch_flush exit 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 20 client.4341.objecter shutdown clearing up homeless session... 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 10 client.4341.objecter successfully canceled tick 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 >> v2:10.20.193.120:6800/397309233 conn(0x7fb6ec073f40 msgr2=0x7fb6ec0943f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 --2- 10.20.193.40:0/743794534 >> v2:10.20.193.120:6800/397309233 conn(0x7fb6ec073f40 0x7fb6ec0943f0 secure :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb708004780 tx=0x7fb708008040 comp rx=0 tx=0).stop 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb71c164bf0 msgr2=0x7fb71c1202e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb71c164bf0 0x7fb71c1202e0 secure :-1 s=READY pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb710003920 tx=0x7fb700005900 comp rx=0 tx=0).stop 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 shutdown_connections 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 --2- 10.20.193.40:0/743794534 >> v2:10.20.193.120:6800/397309233 conn(0x7fb6ec073f40 0x7fb6ec0943f0 unknown :-1 s=CLOSED pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb71c164bf0 0x7fb71c1202e0 unknown :-1 s=CLOSED pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb71c13b1a0 0x7fb71c1646b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 --2- 10.20.193.40:0/743794534 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb700005280 0x7fb71c139930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 >> 10.20.193.40:0/743794534 conn(0x7fb71c0b99b0 msgr2=0x7fb71c138560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 shutdown_connections 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 -- 10.20.193.40:0/743794534 wait complete. 2026-02-24T17:24:58.377 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:24:58.367+0000 7fb720b78640 1 librados: shutdown 2026-02-24T17:24:58.386 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T17:24:59.596 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:24:59.596+0000 7f4ddc2f5640 -1 osd.14 0 waiting for initial osdmap 2026-02-24T17:24:59.596 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:24:59.596+0000 7f4dd23ca640 -1 osd.14 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.596 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:24:59.596+0000 7fce6d276640 -1 osd.6 0 waiting for initial osdmap 2026-02-24T17:24:59.597 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:24:59.596+0000 7f72e8d12640 -1 osd.10 0 waiting for initial osdmap 2026-02-24T17:24:59.597 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:24:59.596+0000 7f72dede7640 -1 osd.10 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.597 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:24:59.596+0000 7fb6b91d7640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T17:24:59.597 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:24:59.596+0000 7fce6334b640 -1 osd.6 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.597 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:24:59.587+0000 7ff66f27a640 -1 osd.8 0 waiting for initial osdmap 2026-02-24T17:24:59.598 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:24:59.593+0000 7fd237837640 -1 osd.11 0 waiting for initial osdmap 2026-02-24T17:24:59.598 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:24:59.587+0000 7fe82080f640 -1 osd.4 0 waiting for initial osdmap 2026-02-24T17:24:59.598 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:24:59.593+0000 7f9d09e04640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T17:24:59.598 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:24:59.587+0000 7f59949e5640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T17:24:59.598 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:24:59.593+0000 7f9b750ad640 -1 osd.15 0 waiting for initial osdmap 2026-02-24T17:24:59.598 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:24:59.587+0000 7fbbb5f45640 -1 osd.12 0 waiting for initial osdmap 2026-02-24T17:24:59.599 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:24:59.600+0000 7f1f5c01a640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T17:24:59.599 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:24:59.593+0000 7f09c1be7640 -1 osd.7 0 waiting for initial osdmap 2026-02-24T17:24:59.599 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:24:59.600+0000 7fb7dc210640 -1 osd.5 0 waiting for initial osdmap 2026-02-24T17:24:59.599 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:24:59.600+0000 7f8fd0be8640 -1 osd.13 0 waiting for initial osdmap 2026-02-24T17:24:59.600 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:24:59.600+0000 7fed3bdf3640 -1 osd.9 0 waiting for initial osdmap 2026-02-24T17:24:59.600 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:24:59.600+0000 7f1f4e0e7640 -1 osd.1 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.600 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:24:59.600+0000 7fb7ce2dd640 -1 osd.5 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.600 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:24:59.600+0000 7fed2dec0640 -1 osd.9 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.600 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:24:59.600+0000 7f8fc2cb5640 -1 osd.13 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.601 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:24:59.591+0000 7ff66534f640 -1 osd.8 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.601 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:24:59.600+0000 7fb6af2ac640 -1 osd.2 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.601 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:24:59.593+0000 7f09b3cb4640 -1 osd.7 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.601 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:24:59.591+0000 7f5986ab2640 -1 osd.0 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.601 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:24:59.597+0000 7f9b6717a640 -1 osd.15 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.602 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:24:59.591+0000 7fe8128dc640 -1 osd.4 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.602 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:24:59.597+0000 7fd22d90c640 -1 osd.11 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.602 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:24:59.591+0000 7fbba8012640 -1 osd.12 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.602 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:24:59.597+0000 7f9cfbed1640 -1 osd.3 0 handle_osd_map injecting map crc failure 2026-02-24T17:24:59.603 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:24:59.600+0000 7f1f536fa640 -1 osd.1 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.603 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:24:59.600+0000 7fce6895e640 -1 osd.6 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.603 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:24:59.597+0000 7f9d014e4640 -1 osd.3 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.603 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:24:59.600+0000 7fb7d38f0640 -1 osd.5 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.603 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:24:59.600+0000 7f72e43fa640 -1 osd.10 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.604 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:24:59.597+0000 7f09b92c7640 -1 osd.7 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.604 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:24:59.604+0000 7f8fc82c8640 -1 osd.13 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.604 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:24:59.600+0000 7fb6b48bf640 -1 osd.2 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.604 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:24:59.597+0000 7f9b6c78d640 -1 osd.15 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.604 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:24:59.604+0000 7fed334d3640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.604 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:24:59.600+0000 7f4dd79dd640 -1 osd.14 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.604 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:24:59.597+0000 7fd232f1f640 -1 osd.11 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.605 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:24:59.595+0000 7f598c0c5640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.605 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:24:59.595+0000 7fe817eef640 -1 osd.4 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.605 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:24:59.595+0000 7ff66a962640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:24:59.605 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:24:59.595+0000 7fbbad625640 -1 osd.12 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T17:25:01.608 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:25:01.605+0000 7f9b6717a640 -1 osd.15 21 handle_osd_map injecting map crc failure 2026-02-24T17:25:02.595 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:25:02.596+0000 7f72dcde3640 -1 osd.10 21 handle_osd_map injecting map crc failure 2026-02-24T17:25:03.281 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:25:03.280+0000 7fb6ad2a8640 -1 osd.2 22 handle_osd_map injecting map crc failure 2026-02-24T17:25:03.808 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:25:03.808+0000 7fce6334b640 -1 osd.6 23 handle_osd_map injecting map crc failure 2026-02-24T17:25:03.906 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:25:03.895+0000 7fe8108d8640 -1 osd.4 23 handle_osd_map injecting map crc failure 2026-02-24T17:25:04.840 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:25:04.837+0000 7f9cfbed1640 -1 osd.3 24 handle_osd_map injecting map crc failure 2026-02-24T17:25:05.997 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T17:25:06.053 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce3b92640 1 Processor -- start 2026-02-24T17:25:06.054 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce3b92640 1 -- start start 2026-02-24T17:25:06.054 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce3b92640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f2cdc1689b0 0x7f2cdc05b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.054 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce3b92640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cdc0586e0 con 0x7f2cdc05b420 2026-02-24T17:25:06.054 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce3b92640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cdc058980 con 0x7f2cdc15ace0 2026-02-24T17:25:06.054 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce3b92640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2cdc058c60 con 0x7f2cdc1689b0 2026-02-24T17:25:06.054 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce1907640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f2cdc05b420 0x7f2cdc059a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45628/0 (socket says 10.20.193.40:45628) 2026-02-24T17:25:06.054 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce1907640 1 -- 10.20.193.40:0/613911261 learned_addr learned my addr 10.20.193.40:0/613911261 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:06.054 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce1106640 1 --2- 10.20.193.40:0/613911261 >> v2:10.20.193.40:3300/0 conn(0x7f2cdc1689b0 0x7f2cdc05b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.055 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce0905640 1 -- 10.20.193.40:0/613911261 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959770647 0 0) 0x7f2cdc0586e0 con 0x7f2cdc05b420 2026-02-24T17:25:06.055 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce0905640 1 -- 10.20.193.40:0/613911261 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cc4003620 con 0x7f2cdc05b420 2026-02-24T17:25:06.055 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.043+0000 7f2ce1106640 1 -- 10.20.193.40:0/613911261 >> v1:10.20.193.109:6789/0 conn(0x7f2cdc15ace0 legacy=0x7f2cdc15b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:06.055 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce1106640 1 -- 10.20.193.40:0/613911261 >> v1:10.20.193.40:6789/0 conn(0x7f2cdc05b420 legacy=0x7f2cdc059a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.055 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce1106640 1 -- 10.20.193.40:0/613911261 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cdc058f40 con 0x7f2cdc1689b0 2026-02-24T17:25:06.056 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce1106640 1 --2- 10.20.193.40:0/613911261 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc1689b0 0x7f2cdc05b7f0 secure :-1 s=READY pgs=79 gs=3 cs=0 l=1 c_cookie=17718147803727964610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cd0004780 tx=0x7f2cd001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e3818d7f12a9c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce0905640 1 -- 10.20.193.40:0/613911261 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2cd00ab450 con 0x7f2cdc1689b0 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce0905640 1 -- 10.20.193.40:0/613911261 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd00b0070 con 0x7f2cdc1689b0 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce0905640 1 -- 10.20.193.40:0/613911261 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2cd00ab810 con 0x7f2cdc1689b0 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 -- 10.20.193.40:0/613911261 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc1689b0 msgr2=0x7f2cdc05b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 --2- 10.20.193.40:0/613911261 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc1689b0 0x7f2cdc05b7f0 secure :-1 s=READY pgs=79 gs=3 cs=0 l=1 c_cookie=17718147803727964610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cd0004780 tx=0x7f2cd001c560 comp rx=0 tx=0).stop 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 -- 10.20.193.40:0/613911261 shutdown_connections 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 --2- 10.20.193.40:0/613911261 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc1689b0 0x7f2cdc05b7f0 unknown :-1 s=CLOSED pgs=79 gs=3 cs=0 l=1 c_cookie=17718147803727964610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 -- 10.20.193.40:0/613911261 >> 10.20.193.40:0/613911261 conn(0x7f2cdc0bb130 msgr2=0x7f2cdc0bb530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 -- 10.20.193.40:0/613911261 shutdown_connections 2026-02-24T17:25:06.057 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 -- 10.20.193.40:0/613911261 wait complete. 2026-02-24T17:25:06.058 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 librados: starting msgr at 2026-02-24T17:25:06.058 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 librados: starting objecter 2026-02-24T17:25:06.058 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 Processor -- start 2026-02-24T17:25:06.058 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 -- start start 2026-02-24T17:25:06.058 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 librados: setting wanted keys 2026-02-24T17:25:06.058 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.047+0000 7f2ce3b92640 1 librados: calling monclient init 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc05b420 0x7f2cdc139300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2cdc15ace0 0x7f2cdc139840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2cdc1689b0 0x7f2cdc156540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc1cb9c0 con 0x7f2cdc05b420 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc05a340 con 0x7f2cdc1689b0 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc1cbb40 con 0x7f2cdc15ace0 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc05b420 0x7f2cdc139300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc05b420 0x7f2cdc139300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48536/0 (socket says 10.20.193.40:48536) 2026-02-24T17:25:06.059 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 -- 10.20.193.40:0/883601085 learned_addr learned my addr 10.20.193.40:0/883601085 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1106640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2cdc15ace0 0x7f2cdc139840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce2108640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2cdc1689b0 0x7f2cdc156540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 -- 10.20.193.40:0/883601085 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2cdc15ace0 msgr2=0x7f2cdc139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2cdc15ace0 0x7f2cdc139840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 -- 10.20.193.40:0/883601085 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2cdc1689b0 msgr2=0x7f2cdc156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2cdc1689b0 0x7f2cdc156540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 -- 10.20.193.40:0/883601085 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cdc13c470 con 0x7f2cdc05b420 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1907640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc05b420 0x7f2cdc139300 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ccc00c730 tx=0x7f2ccc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 10 client.?.objecter ms_handle_connect 0x7f2cdc05b420 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 1 -- 10.20.193.40:0/883601085 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ccc017070 con 0x7f2cdc05b420 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 1 -- 10.20.193.40:0/883601085 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ccc005bf0 con 0x7f2cdc05b420 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cdc13c190 con 0x7f2cdc05b420 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 1 -- 10.20.193.40:0/883601085 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ccc007070 con 0x7f2cdc05b420 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 10 client.4362.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cdc138820 con 0x7f2cdc05b420 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 librados: init done 2026-02-24T17:25:06.060 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cdc05b7f0 con 0x7f2cdc05b420 2026-02-24T17:25:06.061 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 1 -- 10.20.193.40:0/883601085 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 4) ==== 99995+0+0 (secure 0 0 0) 0x7f2ccc024080 con 0x7f2cdc05b420 2026-02-24T17:25:06.061 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 1 --2- 10.20.193.40:0/883601085 >> v2:10.20.193.120:6800/397309233 conn(0x7f2cac074060 0x7f2cac094510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.061 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 1 -- 10.20.193.40:0/883601085 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6321+0+0 (secure 0 0 0) 0x7f2ccc095850 con 0x7f2cdc05b420 2026-02-24T17:25:06.061 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 10 client.4362.objecter ms_dispatch2 0x7f2cdc000ba0 osd_map(25..25 src has 1..25) 2026-02-24T17:25:06.061 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 3 client.4362.objecter handle_osd_map got epochs [25,25] > 0 2026-02-24T17:25:06.061 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 3 client.4362.objecter handle_osd_map decoding full epoch 25 2026-02-24T17:25:06.061 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 20 client.4362.objecter dump_active .. 0 homeless 2026-02-24T17:25:06.062 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1106640 1 --2- 10.20.193.40:0/883601085 >> v2:10.20.193.120:6800/397309233 conn(0x7f2cac074060 0x7f2cac094510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.062 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2cca7fc640 10 client.4362.objecter ms_handle_connect 0x7f2cac074060 2026-02-24T17:25:06.062 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.051+0000 7f2ce1106640 1 --2- 10.20.193.40:0/883601085 >> v2:10.20.193.120:6800/397309233 conn(0x7f2cac074060 0x7f2cac094510 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cd001c5a0 tx=0x7f2cd00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:06.064 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.055+0000 7f2cca7fc640 1 -- 10.20.193.40:0/883601085 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f2ccc05f8a0 con 0x7f2cdc05b420 2026-02-24T17:25:06.150 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.139+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cdc15b4d0 con 0x7f2cdc05b420 2026-02-24T17:25:06.151 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.139+0000 7f2cca7fc640 1 -- 10.20.193.40:0/883601085 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18917 (secure 0 0 0) 0x7f2ccc0651b0 con 0x7f2cdc05b420 2026-02-24T17:25:06.151 INFO:teuthology.misc.health.trial040.stdout: 2026-02-24T17:25:06.152 INFO:teuthology.misc.health.trial040.stdout:{"epoch":25,"fsid":"f24f61d3-eddb-4c62-878a-4823ddf02ae6","created":"2026-02-24T17:24:53.565540+0000","modified":"2026-02-24T17:25:04.802140+0000","last_up_change":"2026-02-24T17:25:00.591515+0000","last_in_change":"2026-02-24T17:24:56.443925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T17:25:01.895992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a63c8bf5-8276-4498-bfa8-84f1c5088edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":1676722186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6805","nonce":1676722186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6807","nonce":1676722186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":1676722186}]},"public_addr":"10.20.193.40:6804/1676722186","cluster_addr":"10.20.193.40:6805/1676722186","heartbeat_back_addr":"10.20.193.40:6807/1676722186","heartbeat_front_addr":"10.20.193.40:6806/1676722186","state":["exists","up"]},{"osd":1,"uuid":"8145c280-0f0a-4c92-8026-76099c124e29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6808","nonce":2000550170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6809","nonce":2000550170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6811","nonce":2000550170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6810","nonce":2000550170}]},"public_addr":"10.20.193.94:6808/2000550170","cluster_addr":"10.20.193.94:6809/2000550170","heartbeat_back_addr":"10.20.193.94:6811/2000550170","heartbeat_front_addr":"10.20.193.94:6810/2000550170","state":["exists","up"]},{"osd":2,"uuid":"c2f26f49-f93a-43e9-b17b-871ec271af4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6800","nonce":1855643564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":1855643564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":1855643564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":1855643564}]},"public_addr":"10.20.193.109:6800/1855643564","cluster_addr":"10.20.193.109:6802/1855643564","heartbeat_back_addr":"10.20.193.109:6806/1855643564","heartbeat_front_addr":"10.20.193.109:6804/1855643564","state":["exists","up"]},{"osd":3,"uuid":"29f34fbd-eed3-4f11-8368-c83f4c080816","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6806","nonce":679060341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6808","nonce":679060341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6812","nonce":679060341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6811","nonce":679060341}]},"public_addr":"10.20.193.120:6806/679060341","cluster_addr":"10.20.193.120:6808/679060341","heartbeat_back_addr":"10.20.193.120:6812/679060341","heartbeat_front_addr":"10.20.193.120:6811/679060341","state":["exists","up"]},{"osd":4,"uuid":"50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":2818881548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6801","nonce":2818881548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6803","nonce":2818881548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":2818881548}]},"public_addr":"10.20.193.40:6800/2818881548","cluster_addr":"10.20.193.40:6801/2818881548","heartbeat_back_addr":"10.20.193.40:6803/2818881548","heartbeat_front_addr":"10.20.193.40:6802/2818881548","state":["exists","up"]},{"osd":5,"uuid":"39b6c845-a7fd-440b-9d84-1969c6236693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6804","nonce":1872957733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6805","nonce":1872957733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6807","nonce":1872957733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6806","nonce":1872957733}]},"public_addr":"10.20.193.94:6804/1872957733","cluster_addr":"10.20.193.94:6805/1872957733","heartbeat_back_addr":"10.20.193.94:6807/1872957733","heartbeat_front_addr":"10.20.193.94:6806/1872957733","state":["exists","up"]},{"osd":6,"uuid":"ca53011f-6445-46ff-bee3-5ac8c76d24f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6809","nonce":2048261086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6811","nonce":2048261086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6815","nonce":2048261086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6813","nonce":2048261086}]},"public_addr":"10.20.193.109:6809/2048261086","cluster_addr":"10.20.193.109:6811/2048261086","heartbeat_back_addr":"10.20.193.109:6815/2048261086","heartbeat_front_addr":"10.20.193.109:6813/2048261086","state":["exists","up"]},{"osd":7,"uuid":"c4862062-f74a-4802-be50-4ac14c0f40f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6813","nonce":1724095478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6814","nonce":1724095478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6816","nonce":1724095478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6815","nonce":1724095478}]},"public_addr":"10.20.193.120:6813/1724095478","cluster_addr":"10.20.193.120:6814/1724095478","heartbeat_back_addr":"10.20.193.120:6816/1724095478","heartbeat_front_addr":"10.20.193.120:6815/1724095478","state":["exists","up"]},{"osd":8,"uuid":"ecbb5459-70a3-4d39-910c-27e89ee16ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":1991872075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6809","nonce":1991872075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6811","nonce":1991872075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":1991872075}]},"public_addr":"10.20.193.40:6808/1991872075","cluster_addr":"10.20.193.40:6809/1991872075","heartbeat_back_addr":"10.20.193.40:6811/1991872075","heartbeat_front_addr":"10.20.193.40:6810/1991872075","state":["exists","up"]},{"osd":9,"uuid":"c08fc40c-17cc-44e9-9250-afa1539de8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6800","nonce":3536923368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6801","nonce":3536923368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6803","nonce":3536923368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6802","nonce":3536923368}]},"public_addr":"10.20.193.94:6800/3536923368","cluster_addr":"10.20.193.94:6801/3536923368","heartbeat_back_addr":"10.20.193.94:6803/3536923368","heartbeat_front_addr":"10.20.193.94:6802/3536923368","state":["exists","up"]},{"osd":10,"uuid":"222e48db-8734-4e1b-885d-90de04f44ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":194638238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":194638238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":194638238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":194638238}]},"public_addr":"10.20.193.109:6808/194638238","cluster_addr":"10.20.193.109:6810/194638238","heartbeat_back_addr":"10.20.193.109:6814/194638238","heartbeat_front_addr":"10.20.193.109:6812/194638238","state":["exists","up"]},{"osd":11,"uuid":"c1ccd78b-db99-4911-8140-67f0af870949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6801","nonce":50161754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6802","nonce":50161754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6804","nonce":50161754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6803","nonce":50161754}]},"public_addr":"10.20.193.120:6801/50161754","cluster_addr":"10.20.193.120:6802/50161754","heartbeat_back_addr":"10.20.193.120:6804/50161754","heartbeat_front_addr":"10.20.193.120:6803/50161754","state":["exists","up"]},{"osd":12,"uuid":"4c58eff7-882b-4bfd-9816-137d0e3ed5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":730213184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6813","nonce":730213184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6815","nonce":730213184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":730213184}]},"public_addr":"10.20.193.40:6812/730213184","cluster_addr":"10.20.193.40:6813/730213184","heartbeat_back_addr":"10.20.193.40:6815/730213184","heartbeat_front_addr":"10.20.193.40:6814/730213184","state":["exists","up"]},{"osd":13,"uuid":"013e1c78-dbc4-4789-9c0b-56e1e9f54a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6812","nonce":666336223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6813","nonce":666336223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6815","nonce":666336223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6814","nonce":666336223}]},"public_addr":"10.20.193.94:6812/666336223","cluster_addr":"10.20.193.94:6813/666336223","heartbeat_back_addr":"10.20.193.94:6815/666336223","heartbeat_front_addr":"10.20.193.94:6814/666336223","state":["exists","up"]},{"osd":14,"uuid":"a54b9053-910e-47f8-9f50-6366eb58ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6801","nonce":1905173416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6803","nonce":1905173416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6807","nonce":1905173416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6805","nonce":1905173416}]},"public_addr":"10.20.193.109:6801/1905173416","cluster_addr":"10.20.193.109:6803/1905173416","heartbeat_back_addr":"10.20.193.109:6807/1905173416","heartbeat_front_addr":"10.20.193.109:6805/1905173416","state":["exists","up"]},{"osd":15,"uuid":"d208141f-10d4-45e4-938a-3971dcc08dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6805","nonce":2868608910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6807","nonce":2868608910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6810","nonce":2868608910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6809","nonce":2868608910}]},"public_addr":"10.20.193.120:6805/2868608910","cluster_addr":"10.20.193.120:6807/2868608910","heartbeat_back_addr":"10.20.193.120:6810/2868608910","heartbeat_front_addr":"10.20.193.120:6809/2868608910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.982747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.062221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.927660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.930679+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.017395+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.103413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.917466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.959311+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.957242+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.106278+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.884709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.824262+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.009640+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.247045+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.835352+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.952132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T17:25:06.153 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 10 librados: watch_flush enter 2026-02-24T17:25:06.153 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 10 librados: watch_flush exit 2026-02-24T17:25:06.153 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 20 client.4362.objecter shutdown clearing up homeless session... 2026-02-24T17:25:06.153 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 10 client.4362.objecter successfully canceled tick 2026-02-24T17:25:06.153 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 >> v2:10.20.193.120:6800/397309233 conn(0x7f2cac074060 msgr2=0x7f2cac094510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.153 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 --2- 10.20.193.40:0/883601085 >> v2:10.20.193.120:6800/397309233 conn(0x7f2cac074060 0x7f2cac094510 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cd001c5a0 tx=0x7f2cd00a7000 comp rx=0 tx=0).stop 2026-02-24T17:25:06.153 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc05b420 msgr2=0x7f2cdc139300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc05b420 0x7f2cdc139300 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ccc00c730 tx=0x7f2ccc00cbf0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 shutdown_connections 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 --2- 10.20.193.40:0/883601085 >> v2:10.20.193.120:6800/397309233 conn(0x7f2cac074060 0x7f2cac094510 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2cdc1689b0 0x7f2cdc156540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2cdc15ace0 0x7f2cdc139840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 --2- 10.20.193.40:0/883601085 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2cdc05b420 0x7f2cdc139300 unknown :-1 s=CLOSED pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 >> 10.20.193.40:0/883601085 conn(0x7f2cdc0bb130 msgr2=0x7f2cdc158770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 shutdown_connections 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 -- 10.20.193.40:0/883601085 wait complete. 2026-02-24T17:25:06.154 INFO:teuthology.misc.health.trial040.stderr:2026-02-24T17:25:06.143+0000 7f2ce3b92640 1 librados: shutdown 2026-02-24T17:25:06.161 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-24T17:25:06.161 INFO:tasks.ceph:Creating RBD pool 2026-02-24T17:25:06.162 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-24T17:25:06.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 Processor -- start 2026-02-24T17:25:06.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- start start 2026-02-24T17:25:06.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f94cc0b7150 0x7f94cc0b7520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f94cc0b3d60 0x7f94cc0aff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94cc0b08e0 con 0x7f94cc0b0460 2026-02-24T17:25:06.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f94cc167650 con 0x7f94cc0b7150 2026-02-24T17:25:06.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f94cc16ad30 con 0x7f94cc0b3d60 2026-02-24T17:25:06.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94cb7fe640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f94cc0b7150 0x7f94cc0b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94caffd640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f94cc0b3d60 0x7f94cc0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94cb7fe640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f94cc0b7150 0x7f94cc0b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:50700/0 (socket says 10.20.193.40:50700) 2026-02-24T17:25:06.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94cb7fe640 1 -- 10.20.193.40:0/301561217 learned_addr learned my addr 10.20.193.40:0/301561217 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:06.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94cb7fe640 1 -- 10.20.193.40:0/301561217 >> v2:10.20.193.109:3300/0 conn(0x7f94cc0b3d60 msgr2=0x7f94cc0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:06.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94cb7fe640 1 --2- 10.20.193.40:0/301561217 >> v2:10.20.193.109:3300/0 conn(0x7f94cc0b3d60 0x7f94cc0aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94cb7fe640 1 -- 10.20.193.40:0/301561217 >> v1:10.20.193.94:6789/0 conn(0x7f94cc0b0460 legacy=0x7f94cc15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94cb7fe640 1 -- 10.20.193.40:0/301561217 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc166a40 con 0x7f94cc0b7150 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94cb7fe640 1 --2- 10.20.193.40:0/301561217 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b7150 0x7f94cc0b7520 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=9037679467983001302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94cc058500 tx=0x7f94b801c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d6c4997aaf7d6d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94ca7fc640 1 -- 10.20.193.40:0/301561217 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b80b0620 con 0x7f94cc0b7150 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94ca7fc640 1 -- 10.20.193.40:0/301561217 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b80b07c0 con 0x7f94cc0b7150 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94ca7fc640 1 -- 10.20.193.40:0/301561217 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b80b0bb0 con 0x7f94cc0b7150 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- 10.20.193.40:0/301561217 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b7150 msgr2=0x7f94cc0b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/301561217 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b7150 0x7f94cc0b7520 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=9037679467983001302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94cc058500 tx=0x7f94b801c5d0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- 10.20.193.40:0/301561217 shutdown_connections 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/301561217 >> v2:10.20.193.109:3300/0 conn(0x7f94cc0b3d60 0x7f94cc0aff20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/301561217 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b7150 0x7f94cc0b7520 unknown :-1 s=CLOSED pgs=58 gs=3 cs=0 l=1 c_cookie=9037679467983001302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- 10.20.193.40:0/301561217 >> 10.20.193.40:0/301561217 conn(0x7f94cc0b9020 msgr2=0x7f94cc0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- 10.20.193.40:0/301561217 shutdown_connections 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.215+0000 7f94d1ad4640 1 -- 10.20.193.40:0/301561217 wait complete. 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 librados: starting msgr at 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 librados: starting objecter 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 Processor -- start 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 -- start start 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 librados: setting wanted keys 2026-02-24T17:25:06.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 librados: calling monclient init 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b0460 0x7f94cc15b1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94cc0b3d60 0x7f94cc05c690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94cc0b7150 0x7f94cc05cbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc16a730 con 0x7f94cc0b3d60 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc0b4130 con 0x7f94cc0b0460 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc16a8b0 con 0x7f94cc0b7150 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94cc0b3d60 0x7f94cc05c690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94cc0b3d60 0x7f94cc05c690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48552/0 (socket says 10.20.193.40:48552) 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 -- 10.20.193.40:0/2097572081 learned_addr learned my addr 10.20.193.40:0/2097572081 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94cb7fe640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b0460 0x7f94cc15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94cbfff640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94cc0b7150 0x7f94cc05cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 -- 10.20.193.40:0/2097572081 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94cc0b7150 msgr2=0x7f94cc05cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94cc0b7150 0x7f94cc05cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 -- 10.20.193.40:0/2097572081 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b0460 msgr2=0x7f94cc15b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b0460 0x7f94cc15b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 -- 10.20.193.40:0/2097572081 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc05d110 con 0x7f94cc0b3d60 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94caffd640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94cc0b3d60 0x7f94cc05c690 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94bc00e8b0 tx=0x7f94bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 10 client.?.objecter ms_handle_connect 0x7f94cc0b3d60 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 1 -- 10.20.193.40:0/2097572081 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94bc017070 con 0x7f94cc0b3d60 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 1 -- 10.20.193.40:0/2097572081 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94bc00cb00 con 0x7f94cc0b3d60 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 1 -- 10.20.193.40:0/2097572081 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94bc013470 con 0x7f94cc0b3d60 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94cc05b5f0 con 0x7f94cc0b3d60 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 10 client.4365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94cc05bbb0 con 0x7f94cc0b3d60 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 librados: init done 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94cc0aff00 con 0x7f94cc0b3d60 2026-02-24T17:25:06.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 1 -- 10.20.193.40:0/2097572081 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 4) ==== 99995+0+0 (secure 0 0 0) 0x7f94bc013610 con 0x7f94cc0b3d60 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 1 --2- 10.20.193.40:0/2097572081 >> v2:10.20.193.120:6800/397309233 conn(0x7f949c074060 0x7f949c094510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 1 -- 10.20.193.40:0/2097572081 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6321+0+0 (secure 0 0 0) 0x7f94bc00f040 con 0x7f94cc0b3d60 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 10 client.4365.objecter ms_dispatch2 0x7f94cc000ba0 osd_map(25..25 src has 1..25) 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 3 client.4365.objecter handle_osd_map got epochs [25,25] > 0 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 3 client.4365.objecter handle_osd_map decoding full epoch 25 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 20 client.4365.objecter dump_active .. 0 homeless 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94cb7fe640 1 --2- 10.20.193.40:0/2097572081 >> v2:10.20.193.120:6800/397309233 conn(0x7f949c074060 0x7f949c094510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94cb7fe640 1 --2- 10.20.193.40:0/2097572081 >> v2:10.20.193.120:6800/397309233 conn(0x7f949c074060 0x7f949c094510 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b80191e0 tx=0x7f94b80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:06.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.219+0000 7f94a7fff640 10 client.4365.objecter ms_handle_connect 0x7f949c074060 2026-02-24T17:25:06.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.223+0000 7f94a7fff640 1 -- 10.20.193.40:0/2097572081 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f94bc060810 con 0x7f94cc0b3d60 2026-02-24T17:25:06.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.311+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f94cc15d130 con 0x7f94cc0b3d60 2026-02-24T17:25:06.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94a7fff640 1 -- 10.20.193.40:0/2097572081 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v26) ==== 109+0+0 (secure 0 0 0) 0x7f94bc066090 con 0x7f94cc0b3d60 2026-02-24T17:25:06.849 INFO:teuthology.orchestra.run.trial040.stderr:pool 'rbd' created 2026-02-24T17:25:06.850 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:25:06.848+0000 7f8fc2cb5640 -1 osd.13 25 handle_osd_map injecting map crc failure 2026-02-24T17:25:06.851 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:25:06.845+0000 7f9cfbed1640 -1 osd.3 25 handle_osd_map injecting map crc failure 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 10 librados: watch_flush enter 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 10 librados: watch_flush exit 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 20 client.4365.objecter shutdown clearing up homeless session... 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 10 client.4365.objecter successfully canceled tick 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 >> v2:10.20.193.120:6800/397309233 conn(0x7f949c074060 msgr2=0x7f949c094510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/2097572081 >> v2:10.20.193.120:6800/397309233 conn(0x7f949c074060 0x7f949c094510 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b80191e0 tx=0x7f94b80a7000 comp rx=0 tx=0).stop 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94cc0b3d60 msgr2=0x7f94cc05c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94cc0b3d60 0x7f94cc05c690 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94bc00e8b0 tx=0x7f94bc00ed70 comp rx=0 tx=0).stop 2026-02-24T17:25:06.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 shutdown_connections 2026-02-24T17:25:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/2097572081 >> v2:10.20.193.120:6800/397309233 conn(0x7f949c074060 0x7f949c094510 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94cc0b7150 0x7f94cc05cbd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94cc0b3d60 0x7f94cc05c690 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 --2- 10.20.193.40:0/2097572081 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94cc0b0460 0x7f94cc15b1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 >> 10.20.193.40:0/2097572081 conn(0x7f94cc0b9020 msgr2=0x7f94cc1536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 shutdown_connections 2026-02-24T17:25:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 -- 10.20.193.40:0/2097572081 wait complete. 2026-02-24T17:25:06.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.839+0000 7f94d1ad4640 1 librados: shutdown 2026-02-24T17:25:06.863 DEBUG:teuthology.orchestra.run.trial040:> rbd --cluster ceph pool init rbd 2026-02-24T17:25:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 Processor -- start 2026-02-24T17:25:06.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- start start 2026-02-24T17:25:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 --2- >> v2:10.20.193.40:3300/0 conn(0x559044c618c0 0x559044c61c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 --2- >> v2:10.20.193.109:3300/0 conn(0x559044bb3560 0x559044bac3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x559044a103b0 con 0x559044bae750 2026-02-24T17:25:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x559044ac8c10 con 0x559044c618c0 2026-02-24T17:25:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x5590449c4570 con 0x559044bb3560 2026-02-24T17:25:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f18249c8640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x559044c618c0 0x559044c61c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f18249c8640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x559044c618c0 0x559044c61c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48554/0 (socket says 10.20.193.40:48554) 2026-02-24T17:25:06.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f18249c8640 1 -- 10.20.193.40:0/3005329610 learned_addr learned my addr 10.20.193.40:0/3005329610 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f181ffff640 1 --2- 10.20.193.40:0/3005329610 >> v2:10.20.193.109:3300/0 conn(0x559044bb3560 0x559044bac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f18249c8640 1 -- 10.20.193.40:0/3005329610 >> v2:10.20.193.109:3300/0 conn(0x559044bb3560 msgr2=0x559044bac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f18249c8640 1 --2- 10.20.193.40:0/3005329610 >> v2:10.20.193.109:3300/0 conn(0x559044bb3560 0x559044bac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f18249c8640 1 -- 10.20.193.40:0/3005329610 >> v1:10.20.193.109:6789/0 conn(0x559044bae750 legacy=0x559044b6e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f18249c8640 1 -- 10.20.193.40:0/3005329610 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590449f71f0 con 0x559044c618c0 2026-02-24T17:25:06.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f18249c8640 1 --2- 10.20.193.40:0/3005329610 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044c618c0 0x559044c61c90 secure :-1 s=READY pgs=82 gs=2 cs=0 l=1 c_cookie=16929840193451777780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x559044bb27a0 tx=0x7f181401b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf2dff532d2def4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:06.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f181f7fe640 1 -- 10.20.193.40:0/3005329610 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18140af070 con 0x559044c618c0 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f181f7fe640 1 -- 10.20.193.40:0/3005329610 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18140aa620 con 0x559044c618c0 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f181f7fe640 1 -- 10.20.193.40:0/3005329610 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18140aaa10 con 0x559044c618c0 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- 10.20.193.40:0/3005329610 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044c618c0 msgr2=0x559044c61c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3005329610 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044c618c0 0x559044c61c90 secure :-1 s=READY pgs=82 gs=2 cs=0 l=1 c_cookie=16929840193451777780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x559044bb27a0 tx=0x7f181401b3f0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- 10.20.193.40:0/3005329610 shutdown_connections 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3005329610 >> v2:10.20.193.109:3300/0 conn(0x559044bb3560 0x559044bac3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3005329610 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044c618c0 0x559044c61c90 unknown :-1 s=CLOSED pgs=82 gs=2 cs=0 l=1 c_cookie=16929840193451777780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- 10.20.193.40:0/3005329610 >> 10.20.193.40:0/3005329610 conn(0x559044bb5770 msgr2=0x559044bb1730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- 10.20.193.40:0/3005329610 shutdown_connections 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.871+0000 7f1825ef1200 1 -- 10.20.193.40:0/3005329610 wait complete. 2026-02-24T17:25:06.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 librados: starting msgr at 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 librados: starting objecter 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 Processor -- start 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 -- start start 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 librados: setting wanted keys 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 librados: calling monclient init 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044bae750 0x559044ba9360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x559044bb3560 0x559044c38700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x559044c618c0 0x559044c38c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x559044a48b10 con 0x559044bae750 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x559044a4d4b0 con 0x559044bb3560 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x5590449d6a30 con 0x559044c618c0 2026-02-24T17:25:06.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044bae750 0x559044ba9360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044bae750 0x559044ba9360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48564/0 (socket says 10.20.193.40:48564) 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 -- 10.20.193.40:0/3672777575 learned_addr learned my addr 10.20.193.40:0/3672777575 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825c51640 1 --2- 10.20.193.40:0/3672777575 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x559044c618c0 0x559044c38c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181ffff640 1 --2- 10.20.193.40:0/3672777575 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x559044bb3560 0x559044c38700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 -- 10.20.193.40:0/3672777575 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x559044c618c0 msgr2=0x559044c38c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 --2- 10.20.193.40:0/3672777575 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x559044c618c0 0x559044c38c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 -- 10.20.193.40:0/3672777575 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x559044bb3560 msgr2=0x559044c38700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 --2- 10.20.193.40:0/3672777575 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x559044bb3560 0x559044c38700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590449f6e20 con 0x559044bae750 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f18249c8640 1 --2- 10.20.193.40:0/3672777575 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044bae750 0x559044ba9360 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1814000c10 tx=0x7f1814018190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 10 client.?.objecter ms_handle_connect 0x559044bae750 2026-02-24T17:25:06.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18140af040 con 0x559044bae750 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18140aa8e0 con 0x559044bae750 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590449bd690 con 0x559044bae750 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18140aacb0 con 0x559044bae750 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 10 client.4371.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590449dcfe0 con 0x559044bae750 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 librados: init done 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 10 librados: wait_for_osdmap waiting 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f18140b4480 con 0x559044bae750 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.120:6800/397309233 conn(0x7f1804072900 0x7f1804092db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:06.891 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f18140bb020 con 0x559044bae750 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_map(26..26 src has 1..26) 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 3 client.4371.objecter handle_osd_map got epochs [26,26] > 0 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 3 client.4371.objecter handle_osd_map decoding full epoch 26 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 20 client.4371.objecter dump_active .. 0 homeless 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 10 librados: wait_for_osdmap done waiting 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x5590449c7d40 con 0x559044bae750 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181ffff640 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.120:6800/397309233 conn(0x7f1804072900 0x7f1804092db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181cff9640 10 client.4371.objecter ms_handle_connect 0x7f1804072900 2026-02-24T17:25:06.892 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:06.875+0000 7f181ffff640 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.120:6800/397309233 conn(0x7f1804072900 0x7f1804092db0 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x559044c394e0 tx=0x7f180c00c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:07.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v27) ==== 141+0+0 (secure 0 0 0) 0x7f1814014fe0 con 0x559044bae750 2026-02-24T17:25:07.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x559044a5c680 con 0x559044bae750 2026-02-24T17:25:07.855 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:25:07.849+0000 7f9cfbed1640 -1 osd.3 26 handle_osd_map injecting map crc failure 2026-02-24T17:25:07.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f18140f8b80 con 0x559044bae750 2026-02-24T17:25:07.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181effd640 10 client.4371.objecter _get_latest_version latest 27, waiting 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181effd640 10 client.4371.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181effd640 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=27}) -- 0x7f17fc002af0 con 0x559044bae750 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 8 ==== osd_map(27..27 src has 1..27) ==== 669+0+0 (secure 0 0 0) 0x7f1814101e00 con 0x559044bae750 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181cff9640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_map(27..27 src has 1..27) 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181cff9640 3 client.4371.objecter handle_osd_map got epochs [27,27] > 26 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181cff9640 3 client.4371.objecter handle_osd_map decoding incremental epoch 27 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f181cff9640 20 client.4371.objecter dump_active .. 0 homeless 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 10 librados: create oid=rbd_trash nspace= 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=create 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:07.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 10 client.4371.objecter _op_submit op 0x559044baad30 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 20 client.4371.objecter _calc_target epoch 27 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 20 client.4371.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 10 client.4371.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [14,0] primary 14 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.109:6801/1905173416 conn(0x559044c43700 0x559044c43ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 20 client.4371.objecter _get_session s=0x5590449dd990 osd=14 3 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 10 client.4371.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.14 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 20 client.4371.objecter get_session s=0x5590449dd990 osd=14 3 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 15 client.4371.objecter _session_op_assign 14 1 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 15 client.4371.objecter _send_op 1 to 2.3 on osd.14 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 --> v2:10.20.193.109:6801/1905173416 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559044c44010 con 0x559044c43700 2026-02-24T17:25:07.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 20 client.4371.objecter put_session s=0x5590449dd990 osd=14 4 2026-02-24T17:25:07.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.843+0000 7f1825ef1200 5 client.4371.objecter 1 in flight 2026-02-24T17:25:07.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.847+0000 7f1825c51640 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.109:6801/1905173416 conn(0x559044c43700 0x559044c43ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:07.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.847+0000 7f1825c51640 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.109:6801/1905173416 conn(0x559044c43700 0x559044c43ad0 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:07.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:07.847+0000 7f181cff9640 10 client.4371.objecter ms_handle_connect 0x559044c43700 2026-02-24T17:25:07.859 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:25:07.855+0000 7f4dd23ca640 -1 osd.14 26 handle_osd_map injecting map crc failure 2026-02-24T17:25:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 1 -- 10.20.193.40:0/3672777575 <== osd.14 v2:10.20.193.109:6801/1905173416 1 ==== osd_op_reply(1 rbd_trash [create] v27'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f181800e480 con 0x559044c43700 2026-02-24T17:25:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_op_reply(1 rbd_trash [create] v27'1 uv1 ondisk = 0) 2026-02-24T17:25:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 10 client.4371.objecter in handle_osd_op_reply 2026-02-24T17:25:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 7 client.4371.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-24T17:25:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 10 client.4371.objecter op 0 rval 0 len 0 2026-02-24T17:25:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 15 client.4371.objecter handle_osd_op_reply completed tid 1 2026-02-24T17:25:08.090 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 15 client.4371.objecter _finish_op 1 2026-02-24T17:25:08.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 20 client.4371.objecter put_session s=0x5590449dd990 osd=14 4 2026-02-24T17:25:08.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 15 client.4371.objecter _session_op_remove 14 1 2026-02-24T17:25:08.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825c51640 5 client.4371.objecter 0 in flight 2026-02-24T17:25:08.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 10 librados: Objecter returned from create r=0 2026-02-24T17:25:08.093 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=call 2026-02-24T17:25:08.093 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 10 client.4371.objecter _op_submit op 0x559044d2edb0 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 20 client.4371.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 20 client.4371.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 10 client.4371.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,7] primary 8 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.40:6808/1991872075 conn(0x559044d2f960 0x559044d4fde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 20 client.4371.objecter _get_session s=0x559044d2f2e0 osd=8 3 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 10 client.4371.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.8 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 20 client.4371.objecter get_session s=0x559044d2f2e0 osd=8 3 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 15 client.4371.objecter _session_op_assign 8 2 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 15 client.4371.objecter _send_op 2 to 2.2 on osd.8 2026-02-24T17:25:08.094 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 --> v2:10.20.193.40:6808/1991872075 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559044d50390 con 0x559044d2f960 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 4 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f1825ef1200 5 client.4371.objecter 1 in flight 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.079+0000 7f18249c8640 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.40:6808/1991872075 conn(0x559044d2f960 0x559044d4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.40:6808/1991872075 conn(0x559044d2f960 0x559044d4fde0 crc :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f181cff9640 10 client.4371.objecter ms_handle_connect 0x559044d2f960 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 1 -- 10.20.193.40:0/3672777575 <== osd.8 v2:10.20.193.40:6808/1991872075 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f18140a8070 con 0x559044d2f960 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 10 client.4371.objecter in handle_osd_op_reply 2026-02-24T17:25:08.095 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 7 client.4371.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 10 client.4371.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 10 client.4371.objecter op 0 rval 0 len 0 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 15 client.4371.objecter handle_osd_op_reply completed tid 2 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 15 client.4371.objecter _finish_op 2 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 4 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 15 client.4371.objecter _session_op_remove 8 2 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 5 client.4371.objecter 0 in flight 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 10 client.4371.objecter _op_submit op 0x559044d2df40 2026-02-24T17:25:08.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 20 client.4371.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 20 client.4371.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 10 client.4371.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,7] primary 8 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 20 client.4371.objecter _get_session s=0x559044d2f2e0 osd=8 3 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 10 client.4371.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.8 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 20 client.4371.objecter get_session s=0x559044d2f2e0 osd=8 3 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 15 client.4371.objecter _session_op_assign 8 3 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 15 client.4371.objecter _send_op 3 to 2.2 on osd.8 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 --> v2:10.20.193.40:6808/1991872075 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559044d2e3f0 con 0x559044d2f960 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 4 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f1825ef1200 5 client.4371.objecter 1 in flight 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 1 -- 10.20.193.40:0/3672777575 <== osd.8 v2:10.20.193.40:6808/1991872075 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f18140a8070 con 0x559044d2f960 2026-02-24T17:25:08.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 10 client.4371.objecter in handle_osd_op_reply 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 7 client.4371.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 10 client.4371.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 10 client.4371.objecter op 0 rval 0 len 0 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 15 client.4371.objecter handle_osd_op_reply completed tid 3 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 15 client.4371.objecter _finish_op 3 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 4 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 15 client.4371.objecter _session_op_remove 8 3 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f18249c8640 5 client.4371.objecter 0 in flight 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f181e7fc640 10 client.4371.objecter allocate_selfmanaged_snap; pool: 2 2026-02-24T17:25:08.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f181e7fc640 10 client.4371.objecter pool_op_submit 4 2026-02-24T17:25:08.099 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.083+0000 7f181e7fc640 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f1800003120 con 0x559044bae750 2026-02-24T17:25:08.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v28) ==== 55+0+0 (secure 0 0 0) 0x7f1814100dd0 con 0x559044bae750 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 pool_op_reply(tid 4 (0) Success v28) 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 10 client.4371.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v28) 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 10 client.4371.objecter have request 4 at 0x7f18000030b0 Op: create unmanaged snap 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 20 client.4371.objecter waiting for client to reach epoch 28 before calling back 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 10 client.4371.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=28}) -- 0x7f1804098b30 con 0x559044bae750 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 10 client.4371.objecter done 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 10 ==== osd_map(28..28 src has 1..28) ==== 629+0+0 (secure 0 0 0) 0x7f181412d320 con 0x559044bae750 2026-02-24T17:25:08.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_map(28..28 src has 1..28) 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 3 client.4371.objecter handle_osd_map got epochs [28,28] > 27 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 3 client.4371.objecter handle_osd_map decoding incremental epoch 28 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181cff9640 20 client.4371.objecter dump_active .. 0 homeless 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 20 librados: queue_aio_write 0x5590449d6690 completion 0x559044c58530 write_seq 1 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=2 needs_version=true op_code=create op_code=write 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 10 client.4371.objecter _op_submit op 0x7f17fc0063c0 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 20 client.4371.objecter _calc_target epoch 28 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 20 client.4371.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 10 client.4371.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,7] primary 8 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 20 client.4371.objecter _get_session s=0x559044d2f2e0 osd=8 3 2026-02-24T17:25:08.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 10 client.4371.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.8 2026-02-24T17:25:08.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 20 client.4371.objecter get_session s=0x559044d2f2e0 osd=8 3 2026-02-24T17:25:08.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 15 client.4371.objecter _session_op_assign 8 5 2026-02-24T17:25:08.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 15 client.4371.objecter _send_op 5 to 2.2 on osd.8 2026-02-24T17:25:08.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 1 -- 10.20.193.40:0/3672777575 --> v2:10.20.193.40:6808/1991872075 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) -- 0x7f17fc006ae0 con 0x559044d2f960 2026-02-24T17:25:08.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 4 2026-02-24T17:25:08.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181effd640 5 client.4371.objecter 1 in flight 2026-02-24T17:25:08.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 1 -- 10.20.193.40:0/3672777575 <== osd.8 v2:10.20.193.40:6808/1991872075 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v28'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f18140a8070 con 0x559044d2f960 2026-02-24T17:25:08.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_op_reply(5 rbd_info [create,write 0~8] v28'1 uv1 ondisk = 0) 2026-02-24T17:25:08.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 10 client.4371.objecter in handle_osd_op_reply 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 7 client.4371.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 10 client.4371.objecter op 0 rval 0 len 0 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 10 client.4371.objecter op 1 rval 0 len 0 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 15 client.4371.objecter handle_osd_op_reply completed tid 5 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 15 client.4371.objecter _finish_op 5 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 4 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 15 client.4371.objecter _session_op_remove 8 5 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 5 client.4371.objecter 0 in flight 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f18249c8640 20 librados: complete_aio_write 0x559044c58530 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181e7fc640 10 client.4371.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-24T17:25:08.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181e7fc640 10 client.4371.objecter pool_op_submit 6 2026-02-24T17:25:08.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:08.847+0000 7f181e7fc640 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v28) -- 0x7f18000033a0 con 0x559044bae750 2026-02-24T17:25:09.162 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:25:09.160+0000 7f1f4c0e3640 -1 osd.1 26 handle_osd_map injecting map crc failure 2026-02-24T17:25:09.285 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:25:09.275+0000 7fbba600e640 -1 osd.12 27 handle_osd_map injecting map crc failure 2026-02-24T17:25:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v29) ==== 43+0+0 (secure 0 0 0) 0x7f1814108080 con 0x559044bae750 2026-02-24T17:25:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 pool_op_reply(tid 6 (0) Success v29) 2026-02-24T17:25:09.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 10 client.4371.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v29) 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 10 client.4371.objecter have request 6 at 0x7f18000030b0 Op: delete unmanaged snap 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 20 client.4371.objecter waiting for client to reach epoch 29 before calling back 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 10 client.4371.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=29}) -- 0x7f1804098e20 con 0x559044bae750 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 10 client.4371.objecter done 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 1 -- 10.20.193.40:0/3672777575 <== mon.0 v2:10.20.193.40:3300/0 12 ==== osd_map(29..29 src has 1..29) ==== 657+0+0 (secure 0 0 0) 0x7f18140f8670 con 0x559044bae750 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_map(29..29 src has 1..29) 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 3 client.4371.objecter handle_osd_map got epochs [29,29] > 28 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 3 client.4371.objecter handle_osd_map decoding incremental epoch 29 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181cff9640 20 client.4371.objecter dump_active .. 0 homeless 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 20 librados: queue_aio_write 0x5590449d6690 completion 0x7f1800001db0 write_seq 2 2026-02-24T17:25:09.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=write 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 10 client.4371.objecter _op_submit op 0x7f17fc0063c0 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 20 client.4371.objecter _calc_target epoch 29 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 20 client.4371.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 10 client.4371.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,7] primary 8 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 20 client.4371.objecter _get_session s=0x559044d2f2e0 osd=8 3 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 10 client.4371.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.8 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 20 client.4371.objecter get_session s=0x559044d2f2e0 osd=8 3 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 15 client.4371.objecter _session_op_assign 8 7 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 15 client.4371.objecter _send_op 7 to 2.2 on osd.8 2026-02-24T17:25:09.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 1 -- 10.20.193.40:0/3672777575 --> v2:10.20.193.40:6808/1991872075 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x7f17fc006e80 con 0x559044d2f960 2026-02-24T17:25:09.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 4 2026-02-24T17:25:09.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.847+0000 7f181effd640 5 client.4371.objecter 1 in flight 2026-02-24T17:25:09.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 1 -- 10.20.193.40:0/3672777575 <== osd.8 v2:10.20.193.40:6808/1991872075 4 ==== osd_op_reply(7 rbd_info [write 0~19] v29'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1814109070 con 0x559044d2f960 2026-02-24T17:25:09.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 10 client.4371.objecter ms_dispatch2 0x559044a7c270 osd_op_reply(7 rbd_info [write 0~19] v29'2 uv2 ondisk = 0) 2026-02-24T17:25:09.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 10 client.4371.objecter in handle_osd_op_reply 2026-02-24T17:25:09.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 7 client.4371.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-24T17:25:09.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 10 client.4371.objecter op 0 rval 0 len 0 2026-02-24T17:25:09.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 15 client.4371.objecter handle_osd_op_reply completed tid 7 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 15 client.4371.objecter _finish_op 7 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 4 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 15 client.4371.objecter _session_op_remove 8 7 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 5 client.4371.objecter 0 in flight 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f18249c8640 20 librados: complete_aio_write 0x7f1800001db0 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 10 librados: watch_flush enter 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 10 librados: watch_flush exit 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 10 client.4371.objecter close_session for osd.8 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 >> v2:10.20.193.40:6808/1991872075 conn(0x559044d2f960 msgr2=0x559044d4fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.40:6808/1991872075 conn(0x559044d2f960 0x559044d4fde0 crc :-1 s=READY pgs=8 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 20 client.4371.objecter put_session s=0x559044d2f2e0 osd=8 1 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 10 client.4371.objecter close_session for osd.14 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 >> v2:10.20.193.109:6801/1905173416 conn(0x559044c43700 msgr2=0x559044c43ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.109:6801/1905173416 conn(0x559044c43700 0x559044c43ad0 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 20 client.4371.objecter put_session s=0x5590449dd990 osd=14 1 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 20 client.4371.objecter shutdown clearing up homeless session... 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 10 client.4371.objecter successfully canceled tick 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 >> v2:10.20.193.120:6800/397309233 conn(0x7f1804072900 msgr2=0x7f1804092db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3672777575 >> v2:10.20.193.120:6800/397309233 conn(0x7f1804072900 0x7f1804092db0 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x559044c394e0 tx=0x7f180c00c040 comp rx=0 tx=0).stop 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044bae750 msgr2=0x559044ba9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:09.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 --2- 10.20.193.40:0/3672777575 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x559044bae750 0x559044ba9360 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1814000c10 tx=0x7f1814018190 comp rx=0 tx=0).stop 2026-02-24T17:25:09.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825c51640 1 -- 10.20.193.40:0/3672777575 reap_dead start 2026-02-24T17:25:09.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 shutdown_connections 2026-02-24T17:25:09.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 >> 10.20.193.40:0/3672777575 conn(0x559044bb5770 msgr2=0x559044c58920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:09.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 shutdown_connections 2026-02-24T17:25:09.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 -- 10.20.193.40:0/3672777575 wait complete. 2026-02-24T17:25:09.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.851+0000 7f1825ef1200 1 librados: shutdown 2026-02-24T17:25:09.869 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-24T17:25:09.870 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-24T17:25:09.871 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-24T17:25:09.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 Processor -- start 2026-02-24T17:25:09.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- start start 2026-02-24T17:25:09.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f19f405d1a0 0x7f19f405d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f19f416ada0 0x7f19f4166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f19f40bc470 0x7f19f40b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f19f4167130 con 0x7f19f416ada0 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f19f41673c0 con 0x7f19f405d1a0 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f19f41676a0 con 0x7f19f40bc470 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f19f416ada0 0x7f19f4166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f19f416ada0 0x7f19f4166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48574/0 (socket says 10.20.193.40:48574) 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 -- 10.20.193.40:0/1411333993 learned_addr learned my addr 10.20.193.40:0/1411333993 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:09.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f3fff640 1 --2- 10.20.193.40:0/1411333993 >> v2:10.20.193.109:3300/0 conn(0x7f19f40bc470 0x7f19f40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:09.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f37fe640 1 --2- 10.20.193.40:0/1411333993 >> v2:10.20.193.94:3300/0 conn(0x7f19f405d1a0 0x7f19f405d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:09.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 -- 10.20.193.40:0/1411333993 >> v2:10.20.193.109:3300/0 conn(0x7f19f40bc470 msgr2=0x7f19f40b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:09.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 --2- 10.20.193.40:0/1411333993 >> v2:10.20.193.109:3300/0 conn(0x7f19f40bc470 0x7f19f40b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 -- 10.20.193.40:0/1411333993 >> v2:10.20.193.94:3300/0 conn(0x7f19f405d1a0 msgr2=0x7f19f405d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:09.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 --2- 10.20.193.40:0/1411333993 >> v2:10.20.193.94:3300/0 conn(0x7f19f405d1a0 0x7f19f405d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 -- 10.20.193.40:0/1411333993 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f4167980 con 0x7f19f416ada0 2026-02-24T17:25:09.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f2ffd640 1 --2- 10.20.193.40:0/1411333993 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f416ada0 0x7f19f4166bf0 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=2368502447793873797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19f405dc70 tx=0x7f19e401c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20de9c6d6a65a385 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:09.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f27fc640 1 -- 10.20.193.40:0/1411333993 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19e40aa620 con 0x7f19f416ada0 2026-02-24T17:25:09.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f27fc640 1 -- 10.20.193.40:0/1411333993 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e40af070 con 0x7f19f416ada0 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f27fc640 1 -- 10.20.193.40:0/1411333993 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19e40aaa00 con 0x7f19f416ada0 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- 10.20.193.40:0/1411333993 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f416ada0 msgr2=0x7f19f4166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1411333993 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f416ada0 0x7f19f4166bf0 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=2368502447793873797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19f405dc70 tx=0x7f19e401c590 comp rx=0 tx=0).stop 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- 10.20.193.40:0/1411333993 shutdown_connections 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1411333993 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f416ada0 0x7f19f4166bf0 unknown :-1 s=CLOSED pgs=84 gs=1 cs=0 l=1 c_cookie=2368502447793873797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1411333993 >> v2:10.20.193.109:3300/0 conn(0x7f19f40bc470 0x7f19f40b4f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1411333993 >> v2:10.20.193.94:3300/0 conn(0x7f19f405d1a0 0x7f19f405d570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- 10.20.193.40:0/1411333993 >> 10.20.193.40:0/1411333993 conn(0x7f19f40bd200 msgr2=0x7f19f40bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- 10.20.193.40:0/1411333993 shutdown_connections 2026-02-24T17:25:09.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.967+0000 7f19f9b31640 1 -- 10.20.193.40:0/1411333993 wait complete. 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 librados: starting msgr at 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 librados: starting objecter 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 Processor -- start 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 -- start start 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 librados: setting wanted keys 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 librados: calling monclient init 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19f405d1a0 0x7f19f4173420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f40bc470 0x7f19f4173960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19f416ada0 0x7f19f417aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f19f40ba9c0 con 0x7f19f40bc470 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f19f415d860 con 0x7f19f416ada0 2026-02-24T17:25:09.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f19f40b5860 con 0x7f19f405d1a0 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f40bc470 0x7f19f4173960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f40bc470 0x7f19f4173960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48582/0 (socket says 10.20.193.40:48582) 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 -- 10.20.193.40:0/1466084044 learned_addr learned my addr 10.20.193.40:0/1466084044 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f37fe640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19f405d1a0 0x7f19f4173420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f3fff640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19f416ada0 0x7f19f417aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 -- 10.20.193.40:0/1466084044 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19f405d1a0 msgr2=0x7f19f4173420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19f405d1a0 0x7f19f4173420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 -- 10.20.193.40:0/1466084044 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19f416ada0 msgr2=0x7f19f417aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19f416ada0 0x7f19f417aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 -- 10.20.193.40:0/1466084044 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f4169300 con 0x7f19f40bc470 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f2ffd640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f40bc470 0x7f19f4173960 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e4002410 tx=0x7f19e401add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:09.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 10 client.?.objecter ms_handle_connect 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 1 -- 10.20.193.40:0/1466084044 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19e4004250 con 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 1 -- 10.20.193.40:0/1466084044 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e40043f0 con 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f41695e0 con 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 1 -- 10.20.193.40:0/1466084044 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19e4003950 con 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 10 client.4377.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f4169ba0 con 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 librados: init done 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f4166bf0 con 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 1 -- 10.20.193.40:0/1466084044 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f19e4003af0 con 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 1 --2- 10.20.193.40:0/1466084044 >> v2:10.20.193.120:6800/397309233 conn(0x7f19c4074100 0x7f19c40945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 1 -- 10.20.193.40:0/1466084044 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f19e4130550 con 0x7f19f40bc470 2026-02-24T17:25:09.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 10 client.4377.objecter ms_dispatch2 0x7f19f4000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:09.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 3 client.4377.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:09.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 3 client.4377.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:09.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19cffff640 20 client.4377.objecter dump_active .. 0 homeless 2026-02-24T17:25:09.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.971+0000 7f19f37fe640 1 --2- 10.20.193.40:0/1466084044 >> v2:10.20.193.120:6800/397309233 conn(0x7f19c4074100 0x7f19c40945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:09.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.975+0000 7f19f37fe640 1 --2- 10.20.193.40:0/1466084044 >> v2:10.20.193.120:6800/397309233 conn(0x7f19c4074100 0x7f19c40945b0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e0004780 tx=0x7f19e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:09.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.975+0000 7f19cffff640 10 client.4377.objecter ms_handle_connect 0x7f19c4074100 2026-02-24T17:25:09.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:09.975+0000 7f19cffff640 1 -- 10.20.193.40:0/1466084044 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f19e40161b0 con 0x7f19f40bc470 2026-02-24T17:25:10.069 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f19f40bd950 con 0x7f19f40bc470 2026-02-24T17:25:10.070 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19cffff640 1 -- 10.20.193.40:0/1466084044 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (secure 0 0 0) 0x7f19e40fa2b0 con 0x7f19f40bc470 2026-02-24T17:25:10.070 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:25:10.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 10 librados: watch_flush enter 2026-02-24T17:25:10.071 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 10 librados: watch_flush exit 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 20 client.4377.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 10 client.4377.objecter successfully canceled tick 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 >> v2:10.20.193.120:6800/397309233 conn(0x7f19c4074100 msgr2=0x7f19c40945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1466084044 >> v2:10.20.193.120:6800/397309233 conn(0x7f19c4074100 0x7f19c40945b0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e0004780 tx=0x7f19e0008040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f40bc470 msgr2=0x7f19f4173960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f40bc470 0x7f19f4173960 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19e4002410 tx=0x7f19e401add0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 shutdown_connections 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1466084044 >> v2:10.20.193.120:6800/397309233 conn(0x7f19c4074100 0x7f19c40945b0 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19f416ada0 0x7f19f417aaf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19f40bc470 0x7f19f4173960 unknown :-1 s=CLOSED pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 --2- 10.20.193.40:0/1466084044 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19f405d1a0 0x7f19f4173420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 >> 10.20.193.40:0/1466084044 conn(0x7f19f40bd200 msgr2=0x7f19f413b890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 shutdown_connections 2026-02-24T17:25:10.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 -- 10.20.193.40:0/1466084044 wait complete. 2026-02-24T17:25:10.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.059+0000 7f19f9b31640 1 librados: shutdown 2026-02-24T17:25:10.076 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:25:10.067+0000 7f5984aae640 -1 osd.0 28 handle_osd_map injecting map crc failure 2026-02-24T17:25:10.076 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:25:10.073+0000 7f9b65176640 -1 osd.15 28 handle_osd_map injecting map crc failure 2026-02-24T17:25:10.077 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:25:10.076+0000 7fed2bebc640 -1 osd.9 28 handle_osd_map injecting map crc failure 2026-02-24T17:25:10.077 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:25:10.073+0000 7fd22b908640 -1 osd.11 28 handle_osd_map injecting map crc failure 2026-02-24T17:25:10.079 INFO:teuthology.orchestra.run.trial040.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-24T17:25:10.080 INFO:tasks.ceph_manager:config epoch is 1 2026-02-24T17:25:10.080 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T17:25:10.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-24T17:25:10.080 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-24T17:25:10.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.139+0000 7f5a2476c640 1 Processor -- start 2026-02-24T17:25:10.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.139+0000 7f5a2476c640 1 -- start start 2026-02-24T17:25:10.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f5a1c05d1a0 0x7f5a1c05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1c1673c0 con 0x7f5a1c16ada0 2026-02-24T17:25:10.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a1c1676a0 con 0x7f5a1c0bc470 2026-02-24T17:25:10.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f5a1c167980 con 0x7f5a1c05d1a0 2026-02-24T17:25:10.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a21ce0640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f5a1c16ada0 0x7f5a1c166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45636/0 (socket says 10.20.193.40:45636) 2026-02-24T17:25:10.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a21ce0640 1 -- 10.20.193.40:0/881176759 learned_addr learned my addr 10.20.193.40:0/881176759 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a224e1640 1 --2- 10.20.193.40:0/881176759 >> v2:10.20.193.109:3300/0 conn(0x7f5a1c05d1a0 0x7f5a1c05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843377691 0 0) 0x7f5a1c1673c0 con 0x7f5a1c16ada0 2026-02-24T17:25:10.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a04003620 con 0x7f5a1c16ada0 2026-02-24T17:25:10.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1130902903 0 0) 0x7f5a04003620 con 0x7f5a1c16ada0 2026-02-24T17:25:10.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 >> v2:10.20.193.109:3300/0 conn(0x7f5a1c05d1a0 msgr2=0x7f5a1c05d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 --2- 10.20.193.40:0/881176759 >> v2:10.20.193.109:3300/0 conn(0x7f5a1c05d1a0 0x7f5a1c05d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 >> v1:10.20.193.109:6789/0 conn(0x7f5a1c0bc470 legacy=0x7f5a1c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c0b4430 con 0x7f5a1c16ada0 2026-02-24T17:25:10.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f5a10002e80 con 0x7f5a1c16ada0 2026-02-24T17:25:10.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 >> v1:10.20.193.40:6789/0 conn(0x7f5a1c16ada0 legacy=0x7f5a1c166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a04003ba0 0x7f5a04003fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a040048d0 0x7f5a04004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a040053a0 0x7f5a04065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c167980 con 0x7f5a040053a0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5a04066290 con 0x7f5a040048d0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f5a04066490 con 0x7f5a04003ba0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a22ce2640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a040053a0 0x7f5a04065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a224e1640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a04003ba0 0x7f5a04003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a21ce0640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a040048d0 0x7f5a04004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a22ce2640 1 -- 10.20.193.40:0/881176759 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a04003ba0 msgr2=0x7f5a04003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a22ce2640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a04003ba0 0x7f5a04003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a22ce2640 1 -- 10.20.193.40:0/881176759 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a040048d0 msgr2=0x7f5a04004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a22ce2640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a040048d0 0x7f5a04004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a22ce2640 1 -- 10.20.193.40:0/881176759 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a04003620 con 0x7f5a040053a0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a22ce2640 1 -- 10.20.193.40:0/881176759 reap_dead start 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a22ce2640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a040053a0 0x7f5a04065a90 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=16969955791828832611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a18004bd0 tx=0x7f5a1801db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8164e1ca0a5163 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a18004820 con 0x7f5a040053a0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a180a6ae0 con 0x7f5a040053a0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a214df640 1 -- 10.20.193.40:0/881176759 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a180ae440 con 0x7f5a040053a0 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 -- 10.20.193.40:0/881176759 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a040053a0 msgr2=0x7f5a04065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a040053a0 0x7f5a04065a90 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=16969955791828832611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a18004bd0 tx=0x7f5a1801db70 comp rx=0 tx=0).stop 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 -- 10.20.193.40:0/881176759 shutdown_connections 2026-02-24T17:25:10.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 --2- 10.20.193.40:0/881176759 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a040053a0 0x7f5a04065a90 unknown :-1 s=CLOSED pgs=87 gs=4 cs=0 l=1 c_cookie=16969955791828832611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 -- 10.20.193.40:0/881176759 >> 10.20.193.40:0/881176759 conn(0x7f5a1c0bd200 msgr2=0x7f5a1c0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 -- 10.20.193.40:0/881176759 shutdown_connections 2026-02-24T17:25:10.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.143+0000 7f5a2476c640 1 -- 10.20.193.40:0/881176759 wait complete. 2026-02-24T17:25:10.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 librados: starting msgr at 2026-02-24T17:25:10.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 librados: starting objecter 2026-02-24T17:25:10.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 Processor -- start 2026-02-24T17:25:10.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 -- start start 2026-02-24T17:25:10.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 librados: setting wanted keys 2026-02-24T17:25:10.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 librados: calling monclient init 2026-02-24T17:25:10.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a040053a0 0x7f5a1c15c130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a1c15c670 0x7f5a1c167f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a1c1684b0 0x7f5a1c120de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c0ba9c0 con 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c05d570 con 0x7f5a1c1684b0 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c0b49f0 con 0x7f5a040053a0 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a1c15c670 0x7f5a1c167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a1c15c670 0x7f5a1c167f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48604/0 (socket says 10.20.193.40:48604) 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 -- 10.20.193.40:0/2827152853 learned_addr learned my addr 10.20.193.40:0/2827152853 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a224e1640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a040053a0 0x7f5a1c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a22ce2640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a1c1684b0 0x7f5a1c120de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 -- 10.20.193.40:0/2827152853 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a040053a0 msgr2=0x7f5a1c15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a040053a0 0x7f5a1c15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 -- 10.20.193.40:0/2827152853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a1c1684b0 msgr2=0x7f5a1c120de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a1c1684b0 0x7f5a1c120de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 -- 10.20.193.40:0/2827152853 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c13c7b0 con 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a22ce2640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a1c1684b0 0x7f5a1c120de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a21ce0640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a1c15c670 0x7f5a1c167f70 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a10007340 tx=0x7f5a10007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 10 client.?.objecter ms_handle_connect 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 1 -- 10.20.193.40:0/2827152853 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a1000fbe0 con 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 1 -- 10.20.193.40:0/2827152853 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a10018070 con 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 1 -- 10.20.193.40:0/2827152853 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a100133f0 con 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1c13ca90 con 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 10 client.4383.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1c13d050 con 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 librados: init done 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1c167320 con 0x7f5a1c15c670 2026-02-24T17:25:10.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 1 -- 10.20.193.40:0/2827152853 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f5a10013590 con 0x7f5a1c15c670 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 1 --2- 10.20.193.40:0/2827152853 >> v2:10.20.193.120:6800/397309233 conn(0x7f59ec074100 0x7f59ec0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 1 -- 10.20.193.40:0/2827152853 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f5a10010040 con 0x7f5a1c15c670 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 10 client.4383.objecter ms_dispatch2 0x7f5a1c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 3 client.4383.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 3 client.4383.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a02ffd640 20 client.4383.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.147+0000 7f5a224e1640 1 --2- 10.20.193.40:0/2827152853 >> v2:10.20.193.120:6800/397309233 conn(0x7f59ec074100 0x7f59ec0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.151+0000 7f5a224e1640 1 --2- 10.20.193.40:0/2827152853 >> v2:10.20.193.120:6800/397309233 conn(0x7f59ec074100 0x7f59ec0945b0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a1c0b42b0 tx=0x7f5a0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.151+0000 7f5a02ffd640 10 client.4383.objecter ms_handle_connect 0x7f59ec074100 2026-02-24T17:25:10.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.151+0000 7f5a02ffd640 1 -- 10.20.193.40:0/2827152853 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f5a1005fe30 con 0x7f5a1c15c670 2026-02-24T17:25:10.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.263+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5a1c13a360 con 0x7f5a1c15c670 2026-02-24T17:25:10.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.263+0000 7f5a02ffd640 1 -- 10.20.193.40:0/2827152853 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189435 (secure 0 0 0) 0x7f5a100657e0 con 0x7f5a1c15c670 2026-02-24T17:25:10.277 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:25:10.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 10 librados: watch_flush enter 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 10 librados: watch_flush exit 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 20 client.4383.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 10 client.4383.objecter successfully canceled tick 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 >> v2:10.20.193.120:6800/397309233 conn(0x7f59ec074100 msgr2=0x7f59ec0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 --2- 10.20.193.40:0/2827152853 >> v2:10.20.193.120:6800/397309233 conn(0x7f59ec074100 0x7f59ec0945b0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a1c0b42b0 tx=0x7f5a0c008040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a1c15c670 msgr2=0x7f5a1c167f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a1c15c670 0x7f5a1c167f70 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a10007340 tx=0x7f5a10007800 comp rx=0 tx=0).stop 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 shutdown_connections 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 --2- 10.20.193.40:0/2827152853 >> v2:10.20.193.120:6800/397309233 conn(0x7f59ec074100 0x7f59ec0945b0 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f5a1c1684b0 0x7f5a1c120de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f5a1c15c670 0x7f5a1c167f70 unknown :-1 s=CLOSED pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 --2- 10.20.193.40:0/2827152853 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f5a040053a0 0x7f5a1c15c130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 >> 10.20.193.40:0/2827152853 conn(0x7f5a1c0bd200 msgr2=0x7f5a1c13dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 shutdown_connections 2026-02-24T17:25:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 -- 10.20.193.40:0/2827152853 wait complete. 2026-02-24T17:25:10.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.267+0000 7f5a2476c640 1 librados: shutdown 2026-02-24T17:25:10.286 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6800","nonce":397309233}]},"active_addr":"10.20.193.120:6800/397309233","active_change":"2026-02-24T17:24:55.849541+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.120:0","nonce":441851371}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.120:0","nonce":4072757856}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.120:0","nonce":763954413}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.120:0","nonce":2806366193}]}]} 2026-02-24T17:25:10.293 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-24T17:25:10.293 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-24T17:25:10.293 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.383+0000 7f008282c640 1 Processor -- start 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.383+0000 7f008282c640 1 -- start start 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f007c161c70 0x7f007c0b3890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007c16e870 con 0x7f007c16ba90 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007c16eb50 con 0x7f007c1618a0 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f007c16e620 con 0x7f007c161c70 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f0080da2640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7f007c16ba90 0x7f007c0b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:59744/0 (socket says 10.20.193.40:59744) 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f0080da2640 1 -- 10.20.193.40:0/2546300847 learned_addr learned my addr 10.20.193.40:0/2546300847 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007bfff640 1 --1- 10.20.193.40:0/2546300847 >> v1:10.20.193.109:6789/0 conn(0x7f007c1618a0 0x7f007c16b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.40:59748/0 (socket says 10.20.193.40:59748) 2026-02-24T17:25:10.395 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 --2- 10.20.193.40:0/2546300847 >> v2:10.20.193.109:3300/0 conn(0x7f007c161c70 0x7f007c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4265819331 0 0) 0x7f007c16e870 con 0x7f007c16ba90 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0060003620 con 0x7f007c16ba90 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 <== mon.1 v1:10.20.193.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2605445513 0 0) 0x7f0060003620 con 0x7f007c16ba90 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 >> v2:10.20.193.109:3300/0 conn(0x7f007c161c70 msgr2=0x7f007c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 --2- 10.20.193.40:0/2546300847 >> v2:10.20.193.109:3300/0 conn(0x7f007c161c70 0x7f007c0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 >> v1:10.20.193.109:6789/0 conn(0x7f007c1618a0 legacy=0x7f007c16b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 --> v1:10.20.193.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c16ee30 con 0x7f007c16ba90 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 <== mon.1 v1:10.20.193.94:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f0070004390 con 0x7f007c16ba90 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 --2- 10.20.193.40:0/2546300847 >> v2:10.20.193.109:3300/0 conn(0x7f007c161c70 0x7f007c0b3890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:25:10.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 >> v1:10.20.193.94:6789/0 conn(0x7f007c16ba90 legacy=0x7f007c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0060003ba0 0x7f0060003fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00600048d0 0x7f0060004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600053a0 0x7f0060065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f007c16e620 con 0x7f00600048d0 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f00600662b0 con 0x7f00600053a0 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f00600664b0 con 0x7f0060003ba0 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00600048d0 0x7f0060004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007bfff640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0060003ba0 0x7f0060003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f0080da2640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600053a0 0x7f0060065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 -- 10.20.193.40:0/2546300847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0060003ba0 msgr2=0x7f0060003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0060003ba0 0x7f0060003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 -- 10.20.193.40:0/2546300847 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600053a0 msgr2=0x7f0060065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600053a0 0x7f0060065a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 -- 10.20.193.40:0/2546300847 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0060003620 con 0x7f00600048d0 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f0080da2640 1 -- 10.20.193.40:0/2546300847 reap_dead start 2026-02-24T17:25:10.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007bfff640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0060003ba0 0x7f0060003fd0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:10.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007b7fe640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00600048d0 0x7f0060004d40 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=9266530462984029708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f006c004780 tx=0x7f006c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8099545c227fc60c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f006c0098c0 con 0x7f00600048d0 2026-02-24T17:25:10.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c004250 con 0x7f00600048d0 2026-02-24T17:25:10.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f007affd640 1 -- 10.20.193.40:0/2546300847 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f006c0a5750 con 0x7f00600048d0 2026-02-24T17:25:10.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 -- 10.20.193.40:0/2546300847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00600048d0 msgr2=0x7f0060004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00600048d0 0x7f0060004d40 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=9266530462984029708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f006c004780 tx=0x7f006c01cc60 comp rx=0 tx=0).stop 2026-02-24T17:25:10.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 -- 10.20.193.40:0/2546300847 shutdown_connections 2026-02-24T17:25:10.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 --2- 10.20.193.40:0/2546300847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00600048d0 0x7f0060004d40 unknown :-1 s=CLOSED pgs=89 gs=4 cs=0 l=1 c_cookie=9266530462984029708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 -- 10.20.193.40:0/2546300847 >> 10.20.193.40:0/2546300847 conn(0x7f007c0b8fd0 msgr2=0x7f007c0b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 -- 10.20.193.40:0/2546300847 shutdown_connections 2026-02-24T17:25:10.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.387+0000 7f008282c640 1 -- 10.20.193.40:0/2546300847 wait complete. 2026-02-24T17:25:10.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 librados: starting msgr at 2026-02-24T17:25:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 librados: starting objecter 2026-02-24T17:25:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 Processor -- start 2026-02-24T17:25:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 -- start start 2026-02-24T17:25:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 librados: setting wanted keys 2026-02-24T17:25:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 librados: calling monclient init 2026-02-24T17:25:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600048d0 0x7f007c11fb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f007c16a8e0 0x7f007c0576b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f007c057bf0 0x7f007c121c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0b2c30 con 0x7f007c057bf0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0b2ab0 con 0x7f00600048d0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0b3ef0 con 0x7f007c16a8e0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f007c057bf0 0x7f007c121c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f007c057bf0 0x7f007c121c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48626/0 (socket says 10.20.193.40:48626) 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 -- 10.20.193.40:0/3513508819 learned_addr learned my addr 10.20.193.40:0/3513508819 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f007b7fe640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f007c16a8e0 0x7f007c0576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f007bfff640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600048d0 0x7f007c11fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 -- 10.20.193.40:0/3513508819 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f007c16a8e0 msgr2=0x7f007c0576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f007c16a8e0 0x7f007c0576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 -- 10.20.193.40:0/3513508819 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600048d0 msgr2=0x7f007c11fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600048d0 0x7f007c11fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 -- 10.20.193.40:0/3513508819 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c168f40 con 0x7f007c057bf0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0080da2640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f007c057bf0 0x7f007c121c20 secure :-1 s=READY pgs=90 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0070003920 tx=0x7f007000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0078ff9640 10 client.?.objecter ms_handle_connect 0x7f007c057bf0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0078ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0078ff9640 1 -- 10.20.193.40:0/3513508819 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0070015650 con 0x7f007c057bf0 2026-02-24T17:25:10.401 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0078ff9640 1 -- 10.20.193.40:0/3513508819 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00700157f0 con 0x7f007c057bf0 2026-02-24T17:25:10.402 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007c169220 con 0x7f007c057bf0 2026-02-24T17:25:10.402 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0078ff9640 1 -- 10.20.193.40:0/3513508819 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0070015c00 con 0x7f007c057bf0 2026-02-24T17:25:10.402 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 10 client.4386.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.402 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007c1697e0 con 0x7f007c057bf0 2026-02-24T17:25:10.402 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 librados: init done 2026-02-24T17:25:10.402 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007c0b4280 con 0x7f007c057bf0 2026-02-24T17:25:10.402 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0078ff9640 1 -- 10.20.193.40:0/3513508819 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f0070014420 con 0x7f007c057bf0 2026-02-24T17:25:10.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.391+0000 7f0078ff9640 1 --2- 10.20.193.40:0/3513508819 >> v2:10.20.193.120:6800/397309233 conn(0x7f004c074100 0x7f004c0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f0078ff9640 1 -- 10.20.193.40:0/3513508819 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f0070097400 con 0x7f007c057bf0 2026-02-24T17:25:10.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f0078ff9640 10 client.4386.objecter ms_dispatch2 0x7f007c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f0078ff9640 3 client.4386.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f0078ff9640 3 client.4386.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f007bfff640 1 --2- 10.20.193.40:0/3513508819 >> v2:10.20.193.120:6800/397309233 conn(0x7f004c074100 0x7f004c0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.403 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f0078ff9640 20 client.4386.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.404 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f0078ff9640 10 client.4386.objecter ms_handle_connect 0x7f004c074100 2026-02-24T17:25:10.404 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f007bfff640 1 --2- 10.20.193.40:0/3513508819 >> v2:10.20.193.120:6800/397309233 conn(0x7f004c074100 0x7f004c0945b0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0068002410 tx=0x7f0068009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.405 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.395+0000 7f0078ff9640 1 -- 10.20.193.40:0/3513508819 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f0070023070 con 0x7f007c057bf0 2026-02-24T17:25:10.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f007c15c820 con 0x7f007c057bf0 2026-02-24T17:25:10.492 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f0078ff9640 1 -- 10.20.193.40:0/3513508819 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20894 (secure 0 0 0) 0x7f0070061200 con 0x7f007c057bf0 2026-02-24T17:25:10.493 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:25:10.493 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":29,"fsid":"f24f61d3-eddb-4c62-878a-4823ddf02ae6","created":"2026-02-24T17:24:53.565540+0000","modified":"2026-02-24T17:25:09.850534+0000","last_up_change":"2026-02-24T17:25:00.591515+0000","last_in_change":"2026-02-24T17:24:56.443925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T17:25:01.895992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T17:25:06.322777+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9499998092651367,"score_stable":5.9499998092651367,"optimal_score":0.62999999523162842,"raw_score_acting":3.75,"raw_score_stable":3.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a63c8bf5-8276-4498-bfa8-84f1c5088edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":1676722186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6805","nonce":1676722186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6807","nonce":1676722186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":1676722186}]},"public_addr":"10.20.193.40:6804/1676722186","cluster_addr":"10.20.193.40:6805/1676722186","heartbeat_back_addr":"10.20.193.40:6807/1676722186","heartbeat_front_addr":"10.20.193.40:6806/1676722186","state":["exists","up"]},{"osd":1,"uuid":"8145c280-0f0a-4c92-8026-76099c124e29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6808","nonce":2000550170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6809","nonce":2000550170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6811","nonce":2000550170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6810","nonce":2000550170}]},"public_addr":"10.20.193.94:6808/2000550170","cluster_addr":"10.20.193.94:6809/2000550170","heartbeat_back_addr":"10.20.193.94:6811/2000550170","heartbeat_front_addr":"10.20.193.94:6810/2000550170","state":["exists","up"]},{"osd":2,"uuid":"c2f26f49-f93a-43e9-b17b-871ec271af4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6800","nonce":1855643564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":1855643564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":1855643564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":1855643564}]},"public_addr":"10.20.193.109:6800/1855643564","cluster_addr":"10.20.193.109:6802/1855643564","heartbeat_back_addr":"10.20.193.109:6806/1855643564","heartbeat_front_addr":"10.20.193.109:6804/1855643564","state":["exists","up"]},{"osd":3,"uuid":"29f34fbd-eed3-4f11-8368-c83f4c080816","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6806","nonce":679060341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6808","nonce":679060341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6812","nonce":679060341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6811","nonce":679060341}]},"public_addr":"10.20.193.120:6806/679060341","cluster_addr":"10.20.193.120:6808/679060341","heartbeat_back_addr":"10.20.193.120:6812/679060341","heartbeat_front_addr":"10.20.193.120:6811/679060341","state":["exists","up"]},{"osd":4,"uuid":"50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":2818881548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6801","nonce":2818881548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6803","nonce":2818881548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":2818881548}]},"public_addr":"10.20.193.40:6800/2818881548","cluster_addr":"10.20.193.40:6801/2818881548","heartbeat_back_addr":"10.20.193.40:6803/2818881548","heartbeat_front_addr":"10.20.193.40:6802/2818881548","state":["exists","up"]},{"osd":5,"uuid":"39b6c845-a7fd-440b-9d84-1969c6236693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6804","nonce":1872957733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6805","nonce":1872957733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6807","nonce":1872957733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6806","nonce":1872957733}]},"public_addr":"10.20.193.94:6804/1872957733","cluster_addr":"10.20.193.94:6805/1872957733","heartbeat_back_addr":"10.20.193.94:6807/1872957733","heartbeat_front_addr":"10.20.193.94:6806/1872957733","state":["exists","up"]},{"osd":6,"uuid":"ca53011f-6445-46ff-bee3-5ac8c76d24f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6809","nonce":2048261086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6811","nonce":2048261086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6815","nonce":2048261086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6813","nonce":2048261086}]},"public_addr":"10.20.193.109:6809/2048261086","cluster_addr":"10.20.193.109:6811/2048261086","heartbeat_back_addr":"10.20.193.109:6815/2048261086","heartbeat_front_addr":"10.20.193.109:6813/2048261086","state":["exists","up"]},{"osd":7,"uuid":"c4862062-f74a-4802-be50-4ac14c0f40f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6813","nonce":1724095478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6814","nonce":1724095478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6816","nonce":1724095478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6815","nonce":1724095478}]},"public_addr":"10.20.193.120:6813/1724095478","cluster_addr":"10.20.193.120:6814/1724095478","heartbeat_back_addr":"10.20.193.120:6816/1724095478","heartbeat_front_addr":"10.20.193.120:6815/1724095478","state":["exists","up"]},{"osd":8,"uuid":"ecbb5459-70a3-4d39-910c-27e89ee16ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":1991872075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6809","nonce":1991872075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6811","nonce":1991872075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":1991872075}]},"public_addr":"10.20.193.40:6808/1991872075","cluster_addr":"10.20.193.40:6809/1991872075","heartbeat_back_addr":"10.20.193.40:6811/1991872075","heartbeat_front_addr":"10.20.193.40:6810/1991872075","state":["exists","up"]},{"osd":9,"uuid":"c08fc40c-17cc-44e9-9250-afa1539de8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6800","nonce":3536923368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6801","nonce":3536923368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6803","nonce":3536923368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6802","nonce":3536923368}]},"public_addr":"10.20.193.94:6800/3536923368","cluster_addr":"10.20.193.94:6801/3536923368","heartbeat_back_addr":"10.20.193.94:6803/3536923368","heartbeat_front_addr":"10.20.193.94:6802/3536923368","state":["exists","up"]},{"osd":10,"uuid":"222e48db-8734-4e1b-885d-90de04f44ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":194638238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":194638238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":194638238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":194638238}]},"public_addr":"10.20.193.109:6808/194638238","cluster_addr":"10.20.193.109:6810/194638238","heartbeat_back_addr":"10.20.193.109:6814/194638238","heartbeat_front_addr":"10.20.193.109:6812/194638238","state":["exists","up"]},{"osd":11,"uuid":"c1ccd78b-db99-4911-8140-67f0af870949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6801","nonce":50161754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6802","nonce":50161754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6804","nonce":50161754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6803","nonce":50161754}]},"public_addr":"10.20.193.120:6801/50161754","cluster_addr":"10.20.193.120:6802/50161754","heartbeat_back_addr":"10.20.193.120:6804/50161754","heartbeat_front_addr":"10.20.193.120:6803/50161754","state":["exists","up"]},{"osd":12,"uuid":"4c58eff7-882b-4bfd-9816-137d0e3ed5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":730213184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6813","nonce":730213184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6815","nonce":730213184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":730213184}]},"public_addr":"10.20.193.40:6812/730213184","cluster_addr":"10.20.193.40:6813/730213184","heartbeat_back_addr":"10.20.193.40:6815/730213184","heartbeat_front_addr":"10.20.193.40:6814/730213184","state":["exists","up"]},{"osd":13,"uuid":"013e1c78-dbc4-4789-9c0b-56e1e9f54a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6812","nonce":666336223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6813","nonce":666336223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6815","nonce":666336223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6814","nonce":666336223}]},"public_addr":"10.20.193.94:6812/666336223","cluster_addr":"10.20.193.94:6813/666336223","heartbeat_back_addr":"10.20.193.94:6815/666336223","heartbeat_front_addr":"10.20.193.94:6814/666336223","state":["exists","up"]},{"osd":14,"uuid":"a54b9053-910e-47f8-9f50-6366eb58ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6801","nonce":1905173416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6803","nonce":1905173416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6807","nonce":1905173416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6805","nonce":1905173416}]},"public_addr":"10.20.193.109:6801/1905173416","cluster_addr":"10.20.193.109:6803/1905173416","heartbeat_back_addr":"10.20.193.109:6807/1905173416","heartbeat_front_addr":"10.20.193.109:6805/1905173416","state":["exists","up"]},{"osd":15,"uuid":"d208141f-10d4-45e4-938a-3971dcc08dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6805","nonce":2868608910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6807","nonce":2868608910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6810","nonce":2868608910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6809","nonce":2868608910}]},"public_addr":"10.20.193.120:6805/2868608910","cluster_addr":"10.20.193.120:6807/2868608910","heartbeat_back_addr":"10.20.193.120:6810/2868608910","heartbeat_front_addr":"10.20.193.120:6809/2868608910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.982747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.062221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.927660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.930679+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.017395+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.103413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.917466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.959311+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.957242+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.106278+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.884709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.824262+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.009640+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.247045+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.835352+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.952132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T17:25:10.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 10 librados: watch_flush enter 2026-02-24T17:25:10.495 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 10 librados: watch_flush exit 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 20 client.4386.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 10 client.4386.objecter successfully canceled tick 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 >> v2:10.20.193.120:6800/397309233 conn(0x7f004c074100 msgr2=0x7f004c0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 --2- 10.20.193.40:0/3513508819 >> v2:10.20.193.120:6800/397309233 conn(0x7f004c074100 0x7f004c0945b0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0068002410 tx=0x7f0068009040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f007c057bf0 msgr2=0x7f007c121c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f007c057bf0 0x7f007c121c20 secure :-1 s=READY pgs=90 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0070003920 tx=0x7f007000ec70 comp rx=0 tx=0).stop 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 shutdown_connections 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 --2- 10.20.193.40:0/3513508819 >> v2:10.20.193.120:6800/397309233 conn(0x7f004c074100 0x7f004c0945b0 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f007c057bf0 0x7f007c121c20 unknown :-1 s=CLOSED pgs=90 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.496 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f007c16a8e0 0x7f007c0576b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.497 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 --2- 10.20.193.40:0/3513508819 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00600048d0 0x7f007c11fb00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.497 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 >> 10.20.193.40:0/3513508819 conn(0x7f007c0b8fd0 msgr2=0x7f007c0b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.497 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 shutdown_connections 2026-02-24T17:25:10.497 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 -- 10.20.193.40:0/3513508819 wait complete. 2026-02-24T17:25:10.497 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.483+0000 7f008282c640 1 librados: shutdown 2026-02-24T17:25:10.502 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-24T17:25:10.502 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T17:25:10.563 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bf6b4640 1 Processor -- start 2026-02-24T17:25:10.564 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bf6b4640 1 -- start start 2026-02-24T17:25:10.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bf6b4640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fc0b80b28d0 0x7fc0b8164910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bf6b4640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b81651b0 con 0x7fc0b80b4320 2026-02-24T17:25:10.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bf6b4640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b8165490 con 0x7fc0b80b2500 2026-02-24T17:25:10.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bf6b4640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b8165770 con 0x7fc0b80b28d0 2026-02-24T17:25:10.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bdc2a640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fc0b80b4320 0x7fc0b80b4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45652/0 (socket says 10.20.193.40:45652) 2026-02-24T17:25:10.567 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bdc2a640 1 -- 10.20.193.40:0/2438715900 learned_addr learned my addr 10.20.193.40:0/2438715900 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bcc28640 1 --2- 10.20.193.40:0/2438715900 >> v2:10.20.193.94:3300/0 conn(0x7fc0b80b28d0 0x7fc0b8164910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2669612040 0 0) 0x7fc0b81651b0 con 0x7fc0b80b4320 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a0003620 con 0x7fc0b80b4320 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1437716855 0 0) 0x7fc0a0003620 con 0x7fc0b80b4320 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 >> v2:10.20.193.94:3300/0 conn(0x7fc0b80b28d0 msgr2=0x7fc0b8164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 --2- 10.20.193.40:0/2438715900 >> v2:10.20.193.94:3300/0 conn(0x7fc0b80b28d0 0x7fc0b8164910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 >> v1:10.20.193.109:6789/0 conn(0x7fc0b80b2500 legacy=0x7fc0b8168840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b80b3560 con 0x7fc0b80b4320 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7fc0b4004390 con 0x7fc0b80b4320 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 >> v1:10.20.193.40:6789/0 conn(0x7fc0b80b4320 legacy=0x7fc0b80b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a0003b50 0x7fc0a0003f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.568 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0a00048d0 0x7fc0a0004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0a00053a0 0x7fc0a0065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8165770 con 0x7fc0a00048d0 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a00662d0 con 0x7fc0a0003b50 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a00664d0 con 0x7fc0a00053a0 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bcc28640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0a00048d0 0x7fc0a0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bd429640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a0003b50 0x7fc0a0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bdc2a640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0a00053a0 0x7fc0a0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bcc28640 1 -- 10.20.193.40:0/2438715900 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0a00053a0 msgr2=0x7fc0a0065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bcc28640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0a00053a0 0x7fc0a0065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bcc28640 1 -- 10.20.193.40:0/2438715900 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a0003b50 msgr2=0x7fc0a0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.569 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bcc28640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a0003b50 0x7fc0a0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bdc2a640 1 -- 10.20.193.40:0/2438715900 reap_dead start 2026-02-24T17:25:10.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bcc28640 1 -- 10.20.193.40:0/2438715900 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a0003620 con 0x7fc0a00048d0 2026-02-24T17:25:10.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0bcc28640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0a00048d0 0x7fc0a0004d40 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=8297008438613321024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0ac009830 tx=0x7fc0ac01c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7324e53729f72540 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.555+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0ac00f040 con 0x7fc0a00048d0 2026-02-24T17:25:10.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac0b0070 con 0x7fc0a00048d0 2026-02-24T17:25:10.570 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0a7fff640 1 -- 10.20.193.40:0/2438715900 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0ac0ab880 con 0x7fc0a00048d0 2026-02-24T17:25:10.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2438715900 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0a00048d0 msgr2=0x7fc0a0004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0a00048d0 0x7fc0a0004d40 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=8297008438613321024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0ac009830 tx=0x7fc0ac01c610 comp rx=0 tx=0).stop 2026-02-24T17:25:10.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2438715900 shutdown_connections 2026-02-24T17:25:10.574 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 --2- 10.20.193.40:0/2438715900 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0a00048d0 0x7fc0a0004d40 unknown :-1 s=CLOSED pgs=92 gs=4 cs=0 l=1 c_cookie=8297008438613321024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2438715900 >> 10.20.193.40:0/2438715900 conn(0x7fc0b80b8fd0 msgr2=0x7fc0b80b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2438715900 shutdown_connections 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2438715900 wait complete. 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 librados: starting msgr at 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 librados: starting objecter 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 Processor -- start 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- start start 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 librados: setting wanted keys 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 librados: calling monclient init 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a00048d0 0x7fc0b81665f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.575 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0b8202b80 0x7fc0b8167e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0b815d490 0x7fc0b8162f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8168c50 con 0x7fc0b815d490 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b80b4b30 con 0x7fc0a00048d0 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81624e0 con 0x7fc0b8202b80 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0b815d490 0x7fc0b8162f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0b815d490 0x7fc0b8162f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48652/0 (socket says 10.20.193.40:48652) 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 -- 10.20.193.40:0/2351139126 learned_addr learned my addr 10.20.193.40:0/2351139126 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bd429640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a00048d0 0x7fc0b81665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bcc28640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0b8202b80 0x7fc0b8167e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 -- 10.20.193.40:0/2351139126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0b8202b80 msgr2=0x7fc0b8167e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0b8202b80 0x7fc0b8167e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.576 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 -- 10.20.193.40:0/2351139126 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a00048d0 msgr2=0x7fc0b81665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a00048d0 0x7fc0b81665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 -- 10.20.193.40:0/2351139126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b8166b30 con 0x7fc0b815d490 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bcc28640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0b8202b80 0x7fc0b8167e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bdc2a640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0b815d490 0x7fc0b8162f30 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0b4004bd0 tx=0x7fc0b400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0a5ffb640 10 client.?.objecter ms_handle_connect 0x7fc0b815d490 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0a5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0a5ffb640 1 -- 10.20.193.40:0/2351139126 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0b401a070 con 0x7fc0b815d490 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0a5ffb640 1 -- 10.20.193.40:0/2351139126 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b40127a0 con 0x7fc0b815d490 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0a5ffb640 1 -- 10.20.193.40:0/2351139126 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0b4012bb0 con 0x7fc0b815d490 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b8166dc0 con 0x7fc0b815d490 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 10 client.4392.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b8167380 con 0x7fc0b815d490 2026-02-24T17:25:10.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 librados: init done 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.559+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b815ed90 con 0x7fc0b815d490 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 1 -- 10.20.193.40:0/2351139126 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fc0b401f440 con 0x7fc0b815d490 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 1 --2- 10.20.193.40:0/2351139126 >> v2:10.20.193.120:6800/397309233 conn(0x7fc088074100 0x7fc0880945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 1 -- 10.20.193.40:0/2351139126 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fc0b4011040 con 0x7fc0b815d490 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 10 client.4392.objecter ms_dispatch2 0x7fc0b8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 3 client.4392.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 3 client.4392.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 20 client.4392.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0bd429640 1 --2- 10.20.193.40:0/2351139126 >> v2:10.20.193.120:6800/397309233 conn(0x7fc088074100 0x7fc0880945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 10 client.4392.objecter ms_handle_connect 0x7fc088074100 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0bd429640 1 --2- 10.20.193.40:0/2351139126 >> v2:10.20.193.120:6800/397309233 conn(0x7fc088074100 0x7fc0880945b0 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0a80037b0 tx=0x7fc0a8007d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.563+0000 7fc0a5ffb640 1 -- 10.20.193.40:0/2351139126 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fc0b40609a0 con 0x7fc0b815d490 2026-02-24T17:25:10.663 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0b81622c0 con 0x7fc0b815d490 2026-02-24T17:25:10.664 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0a5ffb640 1 -- 10.20.193.40:0/2351139126 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20894 (secure 0 0 0) 0x7fc0b40662a0 con 0x7fc0b815d490 2026-02-24T17:25:10.664 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:25:10.664 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":29,"fsid":"f24f61d3-eddb-4c62-878a-4823ddf02ae6","created":"2026-02-24T17:24:53.565540+0000","modified":"2026-02-24T17:25:09.850534+0000","last_up_change":"2026-02-24T17:25:00.591515+0000","last_in_change":"2026-02-24T17:24:56.443925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T17:25:01.895992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T17:25:06.322777+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9499998092651367,"score_stable":5.9499998092651367,"optimal_score":0.62999999523162842,"raw_score_acting":3.75,"raw_score_stable":3.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a63c8bf5-8276-4498-bfa8-84f1c5088edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":1676722186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6805","nonce":1676722186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6807","nonce":1676722186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":1676722186}]},"public_addr":"10.20.193.40:6804/1676722186","cluster_addr":"10.20.193.40:6805/1676722186","heartbeat_back_addr":"10.20.193.40:6807/1676722186","heartbeat_front_addr":"10.20.193.40:6806/1676722186","state":["exists","up"]},{"osd":1,"uuid":"8145c280-0f0a-4c92-8026-76099c124e29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6808","nonce":2000550170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6809","nonce":2000550170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6811","nonce":2000550170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6810","nonce":2000550170}]},"public_addr":"10.20.193.94:6808/2000550170","cluster_addr":"10.20.193.94:6809/2000550170","heartbeat_back_addr":"10.20.193.94:6811/2000550170","heartbeat_front_addr":"10.20.193.94:6810/2000550170","state":["exists","up"]},{"osd":2,"uuid":"c2f26f49-f93a-43e9-b17b-871ec271af4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6800","nonce":1855643564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":1855643564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":1855643564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":1855643564}]},"public_addr":"10.20.193.109:6800/1855643564","cluster_addr":"10.20.193.109:6802/1855643564","heartbeat_back_addr":"10.20.193.109:6806/1855643564","heartbeat_front_addr":"10.20.193.109:6804/1855643564","state":["exists","up"]},{"osd":3,"uuid":"29f34fbd-eed3-4f11-8368-c83f4c080816","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6806","nonce":679060341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6808","nonce":679060341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6812","nonce":679060341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6811","nonce":679060341}]},"public_addr":"10.20.193.120:6806/679060341","cluster_addr":"10.20.193.120:6808/679060341","heartbeat_back_addr":"10.20.193.120:6812/679060341","heartbeat_front_addr":"10.20.193.120:6811/679060341","state":["exists","up"]},{"osd":4,"uuid":"50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":2818881548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6801","nonce":2818881548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6803","nonce":2818881548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":2818881548}]},"public_addr":"10.20.193.40:6800/2818881548","cluster_addr":"10.20.193.40:6801/2818881548","heartbeat_back_addr":"10.20.193.40:6803/2818881548","heartbeat_front_addr":"10.20.193.40:6802/2818881548","state":["exists","up"]},{"osd":5,"uuid":"39b6c845-a7fd-440b-9d84-1969c6236693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6804","nonce":1872957733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6805","nonce":1872957733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6807","nonce":1872957733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6806","nonce":1872957733}]},"public_addr":"10.20.193.94:6804/1872957733","cluster_addr":"10.20.193.94:6805/1872957733","heartbeat_back_addr":"10.20.193.94:6807/1872957733","heartbeat_front_addr":"10.20.193.94:6806/1872957733","state":["exists","up"]},{"osd":6,"uuid":"ca53011f-6445-46ff-bee3-5ac8c76d24f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6809","nonce":2048261086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6811","nonce":2048261086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6815","nonce":2048261086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6813","nonce":2048261086}]},"public_addr":"10.20.193.109:6809/2048261086","cluster_addr":"10.20.193.109:6811/2048261086","heartbeat_back_addr":"10.20.193.109:6815/2048261086","heartbeat_front_addr":"10.20.193.109:6813/2048261086","state":["exists","up"]},{"osd":7,"uuid":"c4862062-f74a-4802-be50-4ac14c0f40f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6813","nonce":1724095478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6814","nonce":1724095478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6816","nonce":1724095478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6815","nonce":1724095478}]},"public_addr":"10.20.193.120:6813/1724095478","cluster_addr":"10.20.193.120:6814/1724095478","heartbeat_back_addr":"10.20.193.120:6816/1724095478","heartbeat_front_addr":"10.20.193.120:6815/1724095478","state":["exists","up"]},{"osd":8,"uuid":"ecbb5459-70a3-4d39-910c-27e89ee16ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":1991872075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6809","nonce":1991872075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6811","nonce":1991872075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":1991872075}]},"public_addr":"10.20.193.40:6808/1991872075","cluster_addr":"10.20.193.40:6809/1991872075","heartbeat_back_addr":"10.20.193.40:6811/1991872075","heartbeat_front_addr":"10.20.193.40:6810/1991872075","state":["exists","up"]},{"osd":9,"uuid":"c08fc40c-17cc-44e9-9250-afa1539de8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6800","nonce":3536923368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6801","nonce":3536923368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6803","nonce":3536923368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6802","nonce":3536923368}]},"public_addr":"10.20.193.94:6800/3536923368","cluster_addr":"10.20.193.94:6801/3536923368","heartbeat_back_addr":"10.20.193.94:6803/3536923368","heartbeat_front_addr":"10.20.193.94:6802/3536923368","state":["exists","up"]},{"osd":10,"uuid":"222e48db-8734-4e1b-885d-90de04f44ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":194638238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":194638238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":194638238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":194638238}]},"public_addr":"10.20.193.109:6808/194638238","cluster_addr":"10.20.193.109:6810/194638238","heartbeat_back_addr":"10.20.193.109:6814/194638238","heartbeat_front_addr":"10.20.193.109:6812/194638238","state":["exists","up"]},{"osd":11,"uuid":"c1ccd78b-db99-4911-8140-67f0af870949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6801","nonce":50161754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6802","nonce":50161754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6804","nonce":50161754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6803","nonce":50161754}]},"public_addr":"10.20.193.120:6801/50161754","cluster_addr":"10.20.193.120:6802/50161754","heartbeat_back_addr":"10.20.193.120:6804/50161754","heartbeat_front_addr":"10.20.193.120:6803/50161754","state":["exists","up"]},{"osd":12,"uuid":"4c58eff7-882b-4bfd-9816-137d0e3ed5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":730213184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6813","nonce":730213184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6815","nonce":730213184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":730213184}]},"public_addr":"10.20.193.40:6812/730213184","cluster_addr":"10.20.193.40:6813/730213184","heartbeat_back_addr":"10.20.193.40:6815/730213184","heartbeat_front_addr":"10.20.193.40:6814/730213184","state":["exists","up"]},{"osd":13,"uuid":"013e1c78-dbc4-4789-9c0b-56e1e9f54a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6812","nonce":666336223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6813","nonce":666336223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6815","nonce":666336223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6814","nonce":666336223}]},"public_addr":"10.20.193.94:6812/666336223","cluster_addr":"10.20.193.94:6813/666336223","heartbeat_back_addr":"10.20.193.94:6815/666336223","heartbeat_front_addr":"10.20.193.94:6814/666336223","state":["exists","up"]},{"osd":14,"uuid":"a54b9053-910e-47f8-9f50-6366eb58ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6801","nonce":1905173416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6803","nonce":1905173416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6807","nonce":1905173416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6805","nonce":1905173416}]},"public_addr":"10.20.193.109:6801/1905173416","cluster_addr":"10.20.193.109:6803/1905173416","heartbeat_back_addr":"10.20.193.109:6807/1905173416","heartbeat_front_addr":"10.20.193.109:6805/1905173416","state":["exists","up"]},{"osd":15,"uuid":"d208141f-10d4-45e4-938a-3971dcc08dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6805","nonce":2868608910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6807","nonce":2868608910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6810","nonce":2868608910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6809","nonce":2868608910}]},"public_addr":"10.20.193.120:6805/2868608910","cluster_addr":"10.20.193.120:6807/2868608910","heartbeat_back_addr":"10.20.193.120:6810/2868608910","heartbeat_front_addr":"10.20.193.120:6809/2868608910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.982747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.062221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.927660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.930679+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.017395+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.103413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.917466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.959311+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.957242+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.106278+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.884709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.824262+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.009640+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.247045+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.835352+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.952132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 10 librados: watch_flush enter 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 10 librados: watch_flush exit 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 20 client.4392.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 10 client.4392.objecter successfully canceled tick 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 >> v2:10.20.193.120:6800/397309233 conn(0x7fc088074100 msgr2=0x7fc0880945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 --2- 10.20.193.40:0/2351139126 >> v2:10.20.193.120:6800/397309233 conn(0x7fc088074100 0x7fc0880945b0 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0a80037b0 tx=0x7fc0a8007d90 comp rx=0 tx=0).stop 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0b815d490 msgr2=0x7fc0b8162f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0b815d490 0x7fc0b8162f30 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0b4004bd0 tx=0x7fc0b400bc80 comp rx=0 tx=0).stop 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 shutdown_connections 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 --2- 10.20.193.40:0/2351139126 >> v2:10.20.193.120:6800/397309233 conn(0x7fc088074100 0x7fc0880945b0 unknown :-1 s=CLOSED pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc0b815d490 0x7fc0b8162f30 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc0b8202b80 0x7fc0b8167e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 --2- 10.20.193.40:0/2351139126 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc0a00048d0 0x7fc0b81665f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 >> 10.20.193.40:0/2351139126 conn(0x7fc0b80b8fd0 msgr2=0x7fc0b80b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 shutdown_connections 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 -- 10.20.193.40:0/2351139126 wait complete. 2026-02-24T17:25:10.665 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.655+0000 7fc0bf6b4640 1 librados: shutdown 2026-02-24T17:25:10.675 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-24T17:25:10.676 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-24T17:25:10.676 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-24T17:25:10.676 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-24T17:25:10.676 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-24T17:25:10.676 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-24T17:25:10.676 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-24T17:25:10.677 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-24T17:25:10.677 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-24T17:25:10.677 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-24T17:25:10.677 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-24T17:25:10.677 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-24T17:25:10.678 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-24T17:25:10.678 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-24T17:25:10.678 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-24T17:25:10.678 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-24T17:25:10.746 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7f198d3bb640 1 Processor -- start 2026-02-24T17:25:10.746 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7fd463c7f640 1 Processor -- start 2026-02-24T17:25:10.747 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7f198d3bb640 1 -- start start 2026-02-24T17:25:10.747 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7fd463c7f640 1 -- start start 2026-02-24T17:25:10.747 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7ff9d00ae640 1 Processor -- start 2026-02-24T17:25:10.748 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7f17895fa640 1 Processor -- start 2026-02-24T17:25:10.748 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7ff9d00ae640 1 -- start start 2026-02-24T17:25:10.748 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7fd463c7f640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fd45c16ada0 0x7fd45c05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.749 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.735+0000 7fd463c7f640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fd45c0bc470 0x7fd45c0b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.749 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17895fa640 1 -- start start 2026-02-24T17:25:10.749 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f19880b2500 0x7f19880b28d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45c1673c0 con 0x7fd45c05d1a0 2026-02-24T17:25:10.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd45c1676a0 con 0x7fd45c0bc470 2026-02-24T17:25:10.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd45c167980 con 0x7fd45c16ada0 2026-02-24T17:25:10.750 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f1988168840 0x7f1988164910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4621f5640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fd45c0bc470 0x7fd45c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4621f5640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fd45c0bc470 0x7fd45c0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48664/0 (socket says 10.20.193.40:48664) 2026-02-24T17:25:10.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4619f4640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7fd45c05d1a0 0x7fd45c166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:59748/0 (socket says 10.20.193.40:59748) 2026-02-24T17:25:10.751 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4621f5640 1 -- 10.20.193.40:0/1451965569 learned_addr learned my addr 10.20.193.40:0/1451965569 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.752 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2bad12640 1 Processor -- start 2026-02-24T17:25:10.752 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f19867fc640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f1988168840 0x7f1988164910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.752 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19881651b0 con 0x7f19880b4320 2026-02-24T17:25:10.752 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f19867fc640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f1988168840 0x7f1988164910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48678/0 (socket says 10.20.193.40:48678) 2026-02-24T17:25:10.752 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f19867fc640 1 -- 10.20.193.40:0/3837722874 learned_addr learned my addr 10.20.193.40:0/3837722874 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.753 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4611f3640 1 --2- 10.20.193.40:0/1451965569 >> v2:10.20.193.94:3300/0 conn(0x7fd45c16ada0 0x7fd45c05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.753 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- 10.20.193.40:0/3837722874 --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f1988165490 con 0x7f1988168840 2026-02-24T17:25:10.753 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- 10.20.193.40:0/3837722874 --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1988165770 con 0x7f19880b2500 2026-02-24T17:25:10.754 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2bad12640 1 -- start start 2026-02-24T17:25:10.754 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1986ffd640 1 --2- 10.20.193.40:0/3837722874 >> v2:10.20.193.94:3300/0 conn(0x7f19880b2500 0x7f19880b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.754 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f19867fc640 1 -- 10.20.193.40:0/3837722874 >> v2:10.20.193.94:3300/0 conn(0x7f19880b2500 msgr2=0x7f19880b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.754 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f19867fc640 1 --2- 10.20.193.40:0/3837722874 >> v2:10.20.193.94:3300/0 conn(0x7f19880b2500 0x7f19880b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.754 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f19867fc640 1 -- 10.20.193.40:0/3837722874 >> v1:10.20.193.109:6789/0 conn(0x7f19880b4320 legacy=0x7f19880b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.755 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f19867fc640 1 -- 10.20.193.40:0/3837722874 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19880b3560 con 0x7f1988168840 2026-02-24T17:25:10.755 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9d00ae640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7ff9c805d1a0 0x7ff9c805d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.755 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9d00ae640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c81673c0 con 0x7ff9c816ada0 2026-02-24T17:25:10.755 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9d00ae640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c81676a0 con 0x7ff9c80bc470 2026-02-24T17:25:10.755 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9d00ae640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c8167980 con 0x7ff9c805d1a0 2026-02-24T17:25:10.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17895fa640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f178405d570 0x7f17840b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17895fa640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17841673c0 con 0x7f178405d1a0 2026-02-24T17:25:10.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17895fa640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17841676a0 con 0x7f178416ada0 2026-02-24T17:25:10.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17895fa640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f1784167980 con 0x7f178405d570 2026-02-24T17:25:10.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4621f5640 1 -- 10.20.193.40:0/1451965569 >> v2:10.20.193.94:3300/0 conn(0x7fd45c16ada0 msgr2=0x7fd45c05d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4621f5640 1 --2- 10.20.193.40:0/1451965569 >> v2:10.20.193.94:3300/0 conn(0x7fd45c16ada0 0x7fd45c05d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.756 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4621f5640 1 -- 10.20.193.40:0/1451965569 >> v1:10.20.193.94:6789/0 conn(0x7fd45c05d1a0 legacy=0x7fd45c166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4621f5640 1 -- 10.20.193.40:0/1451965569 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45c0b4430 con 0x7fd45c0bc470 2026-02-24T17:25:10.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f178405d1a0 0x7f1784166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45658/0 (socket says 10.20.193.40:45658) 2026-02-24T17:25:10.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 -- 10.20.193.40:0/2630729549 learned_addr learned my addr 10.20.193.40:0/2630729549 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9ce624640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7ff9c80bc470 0x7ff9c80b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.40:59770/0 (socket says 10.20.193.40:59770) 2026-02-24T17:25:10.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9ce624640 1 -- 10.20.193.40:0/3242499278 learned_addr learned my addr 10.20.193.40:0/3242499278 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2bad12640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fa2b415d020 0x7fa2b40b4da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2bad12640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fa2b415d3f0 0x7fa2b40b52e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17837fe640 1 --2- 10.20.193.40:0/2630729549 >> v2:10.20.193.109:3300/0 conn(0x7f178405d570 0x7f17840b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2bad12640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fa2b4054260 0x7fa2b4054630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2bad12640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b405ca70 con 0x7fa2b4054260 2026-02-24T17:25:10.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2bad12640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b405cd50 con 0x7fa2b415d020 2026-02-24T17:25:10.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2bad12640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b405d030 con 0x7fa2b415d3f0 2026-02-24T17:25:10.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935618576 0 0) 0x7f17841673c0 con 0x7f178405d1a0 2026-02-24T17:25:10.759 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1770003620 con 0x7f178405d1a0 2026-02-24T17:25:10.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fa2b4054260 0x7fa2b4054630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fa2b4054260 0x7fa2b4054630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48692/0 (socket says 10.20.193.40:48692) 2026-02-24T17:25:10.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 -- 10.20.193.40:0/879977119 learned_addr learned my addr 10.20.193.40:0/879977119 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b8a87640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fa2b415d020 0x7fa2b40b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2abfff640 1 --2- 10.20.193.40:0/879977119 >> v2:10.20.193.109:3300/0 conn(0x7fa2b415d3f0 0x7fa2b40b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4018333312 0 0) 0x7f1770003620 con 0x7f178405d1a0 2026-02-24T17:25:10.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 >> v2:10.20.193.109:3300/0 conn(0x7f178405d570 msgr2=0x7f17840b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 --2- 10.20.193.40:0/2630729549 >> v2:10.20.193.109:3300/0 conn(0x7f178405d570 0x7f17840b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 >> v1:10.20.193.109:6789/0 conn(0x7f178416ada0 legacy=0x7f17840bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17840b4430 con 0x7f178405d1a0 2026-02-24T17:25:10.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858627792 0 0) 0x7ff9c81676a0 con 0x7ff9c80bc470 2026-02-24T17:25:10.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cde23640 1 --2- 10.20.193.40:0/3242499278 >> v2:10.20.193.94:3300/0 conn(0x7ff9c805d1a0 0x7ff9c805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f1778002e80 con 0x7f178405d1a0 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 >> v1:10.20.193.40:6789/0 conn(0x7f178405d1a0 legacy=0x7f1784166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1770003bf0 0x7f1770004000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f17700048d0 0x7f1770004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1770005480 0x7f1770065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1784167980 con 0x7f1770003bf0 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1770066300 con 0x7f1770005480 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f1770066500 con 0x7f17700048d0 2026-02-24T17:25:10.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9b0003620 con 0x7ff9c80bc470 2026-02-24T17:25:10.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519642840 0 0) 0x7ff9c81673c0 con 0x7ff9c816ada0 2026-02-24T17:25:10.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9c81676a0 con 0x7ff9c816ada0 2026-02-24T17:25:10.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 -- 10.20.193.40:0/879977119 >> v2:10.20.193.109:3300/0 conn(0x7fa2b415d3f0 msgr2=0x7fa2b40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 --2- 10.20.193.40:0/879977119 >> v2:10.20.193.109:3300/0 conn(0x7fa2b415d3f0 0x7fa2b40b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 -- 10.20.193.40:0/879977119 >> v2:10.20.193.94:3300/0 conn(0x7fa2b415d020 msgr2=0x7fa2b40b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 --2- 10.20.193.40:0/879977119 >> v2:10.20.193.94:3300/0 conn(0x7fa2b415d020 0x7fa2b40b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 -- 10.20.193.40:0/879977119 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b405d310 con 0x7fa2b4054260 2026-02-24T17:25:10.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 <== mon.2 v1:10.20.193.109:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1922635116 0 0) 0x7ff9b0003620 con 0x7ff9c80bc470 2026-02-24T17:25:10.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 >> v2:10.20.193.94:3300/0 conn(0x7ff9c805d1a0 msgr2=0x7ff9c805d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 --2- 10.20.193.40:0/3242499278 >> v2:10.20.193.94:3300/0 conn(0x7ff9c805d1a0 0x7ff9c805d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 >> v1:10.20.193.94:6789/0 conn(0x7ff9c816ada0 legacy=0x7ff9c8166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1770003bf0 0x7f1770004000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 --> v1:10.20.193.109:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c80b4430 con 0x7ff9c80bc470 2026-02-24T17:25:10.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17827fc640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f17700048d0 0x7f1770004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 <== mon.2 v1:10.20.193.109:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7ff9c4004390 con 0x7ff9c80bc470 2026-02-24T17:25:10.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 >> v1:10.20.193.109:6789/0 conn(0x7ff9c80bc470 legacy=0x7ff9c80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17837fe640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1770005480 0x7f1770065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9b0003d80 0x7ff9b0004170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9b00048d0 0x7ff9b0004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff9b00053a0 0x7ff9b0065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c8167980 con 0x7ff9b00048d0 2026-02-24T17:25:10.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc33e29640 1 Processor -- start 2026-02-24T17:25:10.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b00662d0 con 0x7ff9b00053a0 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b00664d0 con 0x7ff9b0003d80 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 -- 10.20.193.40:0/2630729549 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f17700048d0 msgr2=0x7f1770004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f17700048d0 0x7f1770004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 -- 10.20.193.40:0/2630729549 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1770005480 msgr2=0x7f1770065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1770005480 0x7f1770065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 -- 10.20.193.40:0/2630729549 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1770003620 con 0x7f1770003bf0 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17837fe640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1770005480 0x7f1770065a90 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f17837fe640 1 -- 10.20.193.40:0/2630729549 reap_dead start 2026-02-24T17:25:10.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cd622640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9b00048d0 0x7ff9b0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4621f5640 1 --2- 10.20.193.40:0/1451965569 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd45c0bc470 0x7fd45c0b4f10 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=9380315800263197828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd45c161140 tx=0x7fd45801d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822d938573ac0484 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f089a91e640 1 Processor -- start 2026-02-24T17:25:10.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f089a91e640 1 -- start start 2026-02-24T17:25:10.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f19867fc640 1 --2- 10.20.193.40:0/3837722874 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1988168840 0x7f1988164910 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=2885248684991992556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19880b88b0 tx=0x7f197c01c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280a76646d9c52ec server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4609f2640 1 -- 10.20.193.40:0/1451965569 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4580b3070 con 0x7fd45c0bc470 2026-02-24T17:25:10.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4609f2640 1 -- 10.20.193.40:0/1451965569 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4580a6a40 con 0x7fd45c0bc470 2026-02-24T17:25:10.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd4609f2640 1 -- 10.20.193.40:0/1451965569 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4580a6e50 con 0x7fd45c0bc470 2026-02-24T17:25:10.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9ce624640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff9b00053a0 0x7ff9b0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cde23640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9b0003d80 0x7ff9b0004170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cd622640 1 -- 10.20.193.40:0/3242499278 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9b0003d80 msgr2=0x7ff9b0004170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cd622640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9b0003d80 0x7ff9b0004170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cd622640 1 -- 10.20.193.40:0/3242499278 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff9b00053a0 msgr2=0x7ff9b0065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cd622640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff9b00053a0 0x7ff9b0065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cd622640 1 -- 10.20.193.40:0/3242499278 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b0003620 con 0x7ff9b00048d0 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9ce624640 1 -- 10.20.193.40:0/3242499278 reap_dead start 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cde23640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9b0003d80 0x7ff9b0004170 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc33e29640 1 -- start start 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1985ffb640 1 -- 10.20.193.40:0/3837722874 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f197c0ab640 con 0x7f1988168840 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1985ffb640 1 -- 10.20.193.40:0/3837722874 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197c0b0070 con 0x7f1988168840 2026-02-24T17:25:10.770 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1985ffb640 1 -- 10.20.193.40:0/3837722874 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f197c0aba20 con 0x7f1988168840 2026-02-24T17:25:10.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- 10.20.193.40:0/1451965569 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd45c0bc470 msgr2=0x7fd45c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 --2- 10.20.193.40:0/1451965569 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd45c0bc470 0x7fd45c0b4f10 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=9380315800263197828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd45c161140 tx=0x7fd45801d960 comp rx=0 tx=0).stop 2026-02-24T17:25:10.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- 10.20.193.40:0/3837722874 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1988168840 msgr2=0x7f1988164910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 --2- 10.20.193.40:0/3837722874 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1988168840 0x7f1988164910 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=2885248684991992556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19880b88b0 tx=0x7f197c01c570 comp rx=0 tx=0).stop 2026-02-24T17:25:10.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- 10.20.193.40:0/1451965569 shutdown_connections 2026-02-24T17:25:10.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 --2- 10.20.193.40:0/1451965569 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd45c0bc470 0x7fd45c0b4f10 unknown :-1 s=CLOSED pgs=95 gs=2 cs=0 l=1 c_cookie=9380315800263197828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 --2- 10.20.193.40:0/1451965569 >> v2:10.20.193.94:3300/0 conn(0x7fd45c16ada0 0x7fd45c05d570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- 10.20.193.40:0/1451965569 >> 10.20.193.40:0/1451965569 conn(0x7fd45c0bd200 msgr2=0x7fd45c0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- 10.20.193.40:0/3837722874 shutdown_connections 2026-02-24T17:25:10.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 --2- 10.20.193.40:0/3837722874 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1988168840 0x7f1988164910 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=2885248684991992556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 --2- 10.20.193.40:0/3837722874 >> v2:10.20.193.94:3300/0 conn(0x7f19880b2500 0x7f19880b28d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- 10.20.193.40:0/3837722874 >> 10.20.193.40:0/3837722874 conn(0x7f19880b8fd0 msgr2=0x7f19880b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- 10.20.193.40:0/1451965569 shutdown_connections 2026-02-24T17:25:10.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc33e29640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7efc2c15d1f0 0x7efc2c1637e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- 10.20.193.40:0/1451965569 wait complete. 2026-02-24T17:25:10.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- 10.20.193.40:0/3837722874 shutdown_connections 2026-02-24T17:25:10.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc33e29640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2c164b90 con 0x7efc2c15ce20 2026-02-24T17:25:10.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- 10.20.193.40:0/3837722874 wait complete. 2026-02-24T17:25:10.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc31b9e640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7efc2c15ce20 0x7efc2c160cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45660/0 (socket says 10.20.193.40:45660) 2026-02-24T17:25:10.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc31b9e640 1 -- 10.20.193.40:0/780510206 learned_addr learned my addr 10.20.193.40:0/780510206 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f089a91e640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f089405d570 0x7f08940b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f089a91e640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08941673c0 con 0x7f089405d1a0 2026-02-24T17:25:10.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f089a91e640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08941676a0 con 0x7f089416ada0 2026-02-24T17:25:10.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f089a91e640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f0894167980 con 0x7f089405d570 2026-02-24T17:25:10.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc33e29640 1 -- 10.20.193.40:0/780510206 --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2c164e70 con 0x7efc2c165f10 2026-02-24T17:25:10.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc33e29640 1 -- 10.20.193.40:0/780510206 --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7efc2c163d20 con 0x7efc2c15d1f0 2026-02-24T17:25:10.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0898e94640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f089405d570 0x7f08940b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0898e94640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f089405d570 0x7f08940b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48724/0 (socket says 10.20.193.40:48724) 2026-02-24T17:25:10.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0898e94640 1 -- 10.20.193.40:0/4230330696 learned_addr learned my addr 10.20.193.40:0/4230330696 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc3239f640 1 --2- 10.20.193.40:0/780510206 >> v2:10.20.193.109:3300/0 conn(0x7efc2c15d1f0 0x7efc2c1637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434320957 0 0) 0x7efc2c164b90 con 0x7efc2c15ce20 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc14004770 con 0x7efc2c15ce20 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0893fff640 1 -- 10.20.193.40:0/4230330696 >> v1:10.20.193.40:6789/0 conn(0x7f089405d1a0 legacy=0x7f0894166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0893fff640 1 -- 10.20.193.40:0/4230330696 >> v1:10.20.193.40:6789/0 conn(0x7f089405d1a0 legacy=0x7f0894166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0893fff640 1 --1- 10.20.193.40:0/4230330696 >> v1:10.20.193.40:6789/0 conn(0x7f089405d1a0 0x7f0894166bf0 :-1 s=OPENED pgs=98 gs=1 cs=1 l=1).handle_message read tag failed 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0893fff640 1 --1- 10.20.193.40:0/4230330696 >> v1:10.20.193.40:6789/0 conn(0x7f089405d1a0 0x7f0894166bf0 :-1 s=OPENED pgs=98 gs=1 cs=1 l=1).fault on lossy channel, failing 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0898e94640 1 -- 10.20.193.40:0/4230330696 >> v1:10.20.193.94:6789/0 conn(0x7f089416ada0 legacy=0x7f08940bc470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0898e94640 1 -- 10.20.193.40:0/4230330696 >> v1:10.20.193.40:6789/0 conn(0x7f089405d1a0 legacy=0x7f0894166bf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f0898e94640 1 -- 10.20.193.40:0/4230330696 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08940b4430 con 0x7f089405d570 2026-02-24T17:25:10.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3423342062 0 0) 0x7efc14004770 con 0x7efc2c15ce20 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 >> v2:10.20.193.109:3300/0 conn(0x7efc2c15d1f0 msgr2=0x7efc2c1637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 --2- 10.20.193.40:0/780510206 >> v2:10.20.193.109:3300/0 conn(0x7efc2c15d1f0 0x7efc2c1637e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 >> v1:10.20.193.109:6789/0 conn(0x7efc2c165f10 legacy=0x7efc2c164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c165150 con 0x7efc2c15ce20 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fa2b9288640 1 --2- 10.20.193.40:0/879977119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa2b4054260 0x7fa2b4054630 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=1291481537235482640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b40babe0 tx=0x7fa2b0020140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ec439d94e57810 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7efc1c002e80 con 0x7efc2c15ce20 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 >> v1:10.20.193.40:6789/0 conn(0x7efc2c15ce20 legacy=0x7efc2c160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14004cf0 0x7efc140050e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc14005a20 0x7efc14005e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efc140065d0 0x7efc14003540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c163d20 con 0x7efc14005a20 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc14003e20 con 0x7efc140065d0 2026-02-24T17:25:10.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7efc14004020 con 0x7efc14004cf0 2026-02-24T17:25:10.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1782ffd640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1770003bf0 0x7f1770004000 secure :-1 s=READY pgs=100 gs=5 cs=0 l=1 c_cookie=13879025970969791339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1778002860 tx=0x7f177801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09c34961c134b6b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc3139d640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc14005a20 0x7efc14005e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cd622640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9b00048d0 0x7ff9b0004d40 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=839178125000087279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9bc003170 tx=0x7ff9bc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba55c0efbe896ef server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 librados: starting msgr at 2026-02-24T17:25:10.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 librados: starting objecter 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1778007d00 con 0x7f1770003bf0 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17780a9020 con 0x7f1770003bf0 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f1781ffb640 1 -- 10.20.193.40:0/2630729549 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1778005e30 con 0x7f1770003bf0 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 Processor -- start 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc31b9e640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14004cf0 0x7efc140050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9bc002dc0 con 0x7ff9b00048d0 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 -- start start 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 librados: setting wanted keys 2026-02-24T17:25:10.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7f198d3bb640 1 librados: calling monclient init 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 librados: starting msgr at 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 librados: starting objecter 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0052c0 con 0x7ff9b00048d0 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7ff9cce21640 1 -- 10.20.193.40:0/3242499278 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9bc0068d0 con 0x7ff9b00048d0 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc3139d640 1 -- 10.20.193.40:0/780510206 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14004cf0 msgr2=0x7efc140050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc3139d640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14004cf0 0x7efc140050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc3139d640 1 -- 10.20.193.40:0/780510206 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efc140065d0 msgr2=0x7efc14003540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc3139d640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efc140065d0 0x7efc14003540 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc3139d640 1 -- 10.20.193.40:0/780510206 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc14004770 con 0x7efc14005a20 2026-02-24T17:25:10.779 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 Processor -- start 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7efc3239f640 1 -- 10.20.193.40:0/780510206 reap_dead start 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 -- start start 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 librados: setting wanted keys 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.739+0000 7fd463c7f640 1 librados: calling monclient init 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2ab7fe640 1 -- 10.20.193.40:0/879977119 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2b00b5070 con 0x7fa2b4054260 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2ab7fe640 1 -- 10.20.193.40:0/879977119 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b00b0620 con 0x7fa2b4054260 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2ab7fe640 1 -- 10.20.193.40:0/879977119 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2b00b0a30 con 0x7fa2b4054260 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- 10.20.193.40:0/3242499278 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9b00048d0 msgr2=0x7ff9b0004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.780 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9b00048d0 0x7ff9b0004d40 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=839178125000087279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9bc003170 tx=0x7ff9bc01ed10 comp rx=0 tx=0).stop 2026-02-24T17:25:10.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- 10.20.193.40:0/2630729549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1770003bf0 msgr2=0x7f1770004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1770003bf0 0x7f1770004000 secure :-1 s=READY pgs=100 gs=5 cs=0 l=1 c_cookie=13879025970969791339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1778002860 tx=0x7f177801cbe0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc367d6d640 1 Processor -- start 2026-02-24T17:25:10.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- 10.20.193.40:0/2630729549 shutdown_connections 2026-02-24T17:25:10.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 --2- 10.20.193.40:0/2630729549 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1770003bf0 0x7f1770004000 unknown :-1 s=CLOSED pgs=100 gs=5 cs=0 l=1 c_cookie=13879025970969791339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- 10.20.193.40:0/2630729549 >> 10.20.193.40:0/2630729549 conn(0x7f17840bd200 msgr2=0x7f17840bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- 10.20.193.40:0/3242499278 shutdown_connections 2026-02-24T17:25:10.781 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 --2- 10.20.193.40:0/3242499278 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9b00048d0 0x7ff9b0004d40 unknown :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=839178125000087279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- 10.20.193.40:0/3242499278 >> 10.20.193.40:0/3242499278 conn(0x7ff9c80bd200 msgr2=0x7ff9c80bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- 10.20.193.40:0/2630729549 shutdown_connections 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc367d6d640 1 -- start start 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- 10.20.193.40:0/3242499278 shutdown_connections 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd45c05d1a0 0x7fd45c165d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd45c0bc470 0x7fd45c162b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd45c16ada0 0x7fd45c158280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd45c0ba9c0 con 0x7fd45c16ada0 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd45c15d9e0 con 0x7fd45c05d1a0 2026-02-24T17:25:10.782 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fd45c15d860 con 0x7fd45c0bc470 2026-02-24T17:25:10.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- 10.20.193.40:0/3242499278 wait complete. 2026-02-24T17:25:10.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd45c05d1a0 0x7fd45c165d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- 10.20.193.40:0/879977119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa2b4054260 msgr2=0x7fa2b4054630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 --2- 10.20.193.40:0/879977119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa2b4054260 0x7fa2b4054630 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=1291481537235482640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b40babe0 tx=0x7fa2b0020140 comp rx=0 tx=0).stop 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19880b2500 0x7f19881420a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19880b4320 0x7f198817ad10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19880b4320 0x7f198817ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1988168840 0x7f1988161920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19880b4320 0x7f198817ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48740/0 (socket says 10.20.193.40:48740) 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 -- 10.20.193.40:0/303361132 learned_addr learned my addr 10.20.193.40:0/303361132 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 -- 10.20.193.40:0/303361132 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f19880567f0 con 0x7f19880b4320 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 -- 10.20.193.40:0/303361132 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1988168c80 con 0x7f19880b2500 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 -- 10.20.193.40:0/303361132 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f19880b1380 con 0x7f1988168840 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f1986ffd640 1 --2- 10.20.193.40:0/303361132 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19880b2500 0x7f19881420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19877fe640 1 --2- 10.20.193.40:0/303361132 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1988168840 0x7f1988161920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4611f3640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd45c0bc470 0x7fd45c162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd45c05d1a0 0x7fd45c165d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:50900/0 (socket says 10.20.193.40:50900) 2026-02-24T17:25:10.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 -- 10.20.193.40:0/625137846 learned_addr learned my addr 10.20.193.40:0/625137846 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4621f5640 1 --2- 10.20.193.40:0/625137846 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd45c16ada0 0x7fd45c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 -- 10.20.193.40:0/303361132 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1988168840 msgr2=0x7f1988161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 --2- 10.20.193.40:0/303361132 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1988168840 0x7f1988161920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 -- 10.20.193.40:0/303361132 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19880b2500 msgr2=0x7f19881420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 --2- 10.20.193.40:0/303361132 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19880b2500 0x7f19881420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 -- 10.20.193.40:0/303361132 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198815df30 con 0x7f19880b4320 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19677fe640 10 client.?.objecter ms_handle_connect 0x7f19880b4320 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19867fc640 1 --2- 10.20.193.40:0/303361132 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19880b4320 0x7f198817ad10 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f197c002410 tx=0x7f197c01adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19677fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.785 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc3139d640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc14005a20 0x7efc14005e90 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=2042386097759475606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc20007fd0 tx=0x7efc2001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c580355bb265796 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 -- 10.20.193.40:0/625137846 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd45c0bc470 msgr2=0x7fd45c162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 --2- 10.20.193.40:0/625137846 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd45c0bc470 0x7fd45c162b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 -- 10.20.193.40:0/625137846 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd45c16ada0 msgr2=0x7fd45c158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 --2- 10.20.193.40:0/625137846 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd45c16ada0 0x7fd45c158280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 -- 10.20.193.40:0/625137846 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45c1617f0 con 0x7fd45c05d1a0 2026-02-24T17:25:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc200b0070 con 0x7efc14005a20 2026-02-24T17:25:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc20006af0 con 0x7efc14005a20 2026-02-24T17:25:10.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc30b9c640 1 -- 10.20.193.40:0/780510206 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc20003af0 con 0x7efc14005a20 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- 10.20.193.40:0/2630729549 wait complete. 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 librados: starting msgr at 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 librados: starting objecter 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 Processor -- start 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4619f4640 1 --2- 10.20.193.40:0/625137846 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd45c05d1a0 0x7fd45c165d50 secure :-1 s=READY pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd44c00c500 tx=0x7fd44c00c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 10 client.?.objecter ms_handle_connect 0x7fd45c05d1a0 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc367d6d640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fc36015b530 0x7fc3600b3600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc367d6d640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc360167ed0 0x7fc360168300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc367d6d640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3600b3c60 con 0x7fc36015b160 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc367d6d640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc36005ae80 con 0x7fc360167ed0 2026-02-24T17:25:10.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc367d6d640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc3600b4b50 con 0x7fc36015b530 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 librados: starting msgr at 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 librados: starting objecter 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3662e3640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc360167ed0 0x7fc360168300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3662e3640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc360167ed0 0x7fc360168300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48750/0 (socket says 10.20.193.40:48750) 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3662e3640 1 -- 10.20.193.40:0/1670086775 learned_addr learned my addr 10.20.193.40:0/1670086775 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- 10.20.193.40:0/780510206 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc14005a20 msgr2=0x7efc14005e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc14005a20 0x7efc14005e90 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=2042386097759475606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc20007fd0 tx=0x7efc2001c3c0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd44c017070 con 0x7fd45c05d1a0 2026-02-24T17:25:10.788 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 Processor -- start 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- 10.20.193.40:0/780510206 shutdown_connections 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 --2- 10.20.193.40:0/780510206 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc14005a20 0x7efc14005e90 unknown :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=2042386097759475606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- 10.20.193.40:0/780510206 >> 10.20.193.40:0/780510206 conn(0x7efc2c0b8a60 msgr2=0x7efc2c054260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44c005d40 con 0x7fd45c05d1a0 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45c161ad0 con 0x7fd45c05d1a0 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 10 client.4384.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd45c162090 con 0x7fd45c05d1a0 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 librados: init done 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3652e1640 1 --2- 10.20.193.40:0/1670086775 >> v2:10.20.193.94:3300/0 conn(0x7fc36015b530 0x7fc3600b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd44c007310 con 0x7fd45c05d1a0 2026-02-24T17:25:10.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f197c0abcf0 con 0x7f19880b4320 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- start start 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 librados: setting wanted keys 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 librados: calling monclient init 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1770003bf0 0x7f178412e1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1784133420 0x7f1784131760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f178416a3a0 0x7f1784134bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17840b5090 con 0x7f1784133420 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f17840b4f10 con 0x7f178416a3a0 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f17840b5210 con 0x7f1770003bf0 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3662e3640 1 -- 10.20.193.40:0/1670086775 >> v2:10.20.193.94:3300/0 conn(0x7fc36015b530 msgr2=0x7fc3600b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3662e3640 1 --2- 10.20.193.40:0/1670086775 >> v2:10.20.193.94:3300/0 conn(0x7fc36015b530 0x7fc3600b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3662e3640 1 -- 10.20.193.40:0/1670086775 >> v1:10.20.193.109:6789/0 conn(0x7fc36015b160 legacy=0x7fc3600b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3662e3640 1 -- 10.20.193.40:0/1670086775 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3600b3f40 con 0x7fc360167ed0 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0898e94640 1 --2- 10.20.193.40:0/4230330696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 0x7f08940b4f10 secure :-1 s=READY pgs=102 gs=3 cs=0 l=1 c_cookie=5434364450766040823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f088800a580 tx=0x7f088801d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6abdacebebaef7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0892ffd640 1 -- 10.20.193.40:0/4230330696 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08880b3070 con 0x7f089405d570 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0892ffd640 1 -- 10.20.193.40:0/4230330696 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08880a68c0 con 0x7f089405d570 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0892ffd640 1 -- 10.20.193.40:0/4230330696 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08880a6cd0 con 0x7f089405d570 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- 10.20.193.40:0/4230330696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 msgr2=0x7f08940b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 --2- 10.20.193.40:0/4230330696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 0x7f08940b4f10 secure :-1 s=READY pgs=102 gs=3 cs=0 l=1 c_cookie=5434364450766040823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f088800a580 tx=0x7f088801d970 comp rx=0 tx=0).stop 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- 10.20.193.40:0/4230330696 shutdown_connections 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 --2- 10.20.193.40:0/4230330696 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 0x7f08940b4f10 unknown :-1 s=CLOSED pgs=102 gs=3 cs=0 l=1 c_cookie=5434364450766040823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- 10.20.193.40:0/4230330696 >> 10.20.193.40:0/4230330696 conn(0x7f08940bd200 msgr2=0x7f08940bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- 10.20.193.40:0/4230330696 shutdown_connections 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- 10.20.193.40:0/4230330696 wait complete. 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f1782ffd640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1770003bf0 0x7f178412e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17827fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1784133420 0x7f1784131760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f1782ffd640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1770003bf0 0x7f178412e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:50930/0 (socket says 10.20.193.40:50930) 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f1782ffd640 1 -- 10.20.193.40:0/4180093076 learned_addr learned my addr 10.20.193.40:0/4180093076 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 librados: starting msgr at 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 librados: starting objecter 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 Processor -- start 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- 10.20.193.40:0/879977119 shutdown_connections 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 --2- 10.20.193.40:0/879977119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa2b4054260 0x7fa2b4054630 unknown :-1 s=CLOSED pgs=99 gs=3 cs=0 l=1 c_cookie=1291481537235482640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 --2- 10.20.193.40:0/879977119 >> v2:10.20.193.109:3300/0 conn(0x7fa2b415d3f0 0x7fa2b40b52e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 --2- 10.20.193.40:0/879977119 >> v2:10.20.193.94:3300/0 conn(0x7fa2b415d020 0x7fa2b40b4da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- 10.20.193.40:0/879977119 >> 10.20.193.40:0/879977119 conn(0x7fa2b40b9b50 msgr2=0x7fa2b40b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- 10.20.193.40:0/879977119 shutdown_connections 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- 10.20.193.40:0/879977119 wait complete. 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- start start 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 librados: setting wanted keys 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 librados: calling monclient init 2026-02-24T17:25:10.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- 10.20.193.40:0/780510206 shutdown_connections 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- 10.20.193.40:0/780510206 wait complete. 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 10 client.4384.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 15 client.4384.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 20 client.4384.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 10 client.4384.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd45c057810 con 0x7fd45c05d1a0 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- start start 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 librados: setting wanted keys 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 librados: calling monclient init 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff9b00048d0 0x7ff9c8162ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9c81648c0 0x7ff9c8128f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9c8126e20 0x7ff9c8129460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c80ba9c0 con 0x7ff9c81648c0 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c80bc8b0 con 0x7ff9b00048d0 2026-02-24T17:25:10.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c80b49f0 con 0x7ff9c8126e20 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17827fc640 1 -- 10.20.193.40:0/4180093076 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1770003bf0 msgr2=0x7f178412e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17827fc640 1 --2- 10.20.193.40:0/4180093076 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1770003bf0 0x7f178412e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17827fc640 1 -- 10.20.193.40:0/4180093076 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f178416a3a0 msgr2=0x7f1784134bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17827fc640 1 --2- 10.20.193.40:0/4180093076 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f178416a3a0 0x7f1784134bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17827fc640 1 -- 10.20.193.40:0/4180093076 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17841320a0 con 0x7f1784133420 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9c81648c0 0x7ff9c8128f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9c81648c0 0x7ff9c8128f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48768/0 (socket says 10.20.193.40:48768) 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 -- 10.20.193.40:0/866588365 learned_addr learned my addr 10.20.193.40:0/866588365 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9ce624640 1 --2- 10.20.193.40:0/866588365 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9c8126e20 0x7ff9c8129460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f089405d1a0 0x7f0894158950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 0x7f0894158e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cde23640 1 --2- 10.20.193.40:0/866588365 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff9b00048d0 0x7ff9c8162ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f089416ada0 0x7f0894139d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08941ce520 con 0x7f089405d570 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f08940b5860 con 0x7f089405d1a0 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f089a91e640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f08941ce6a0 con 0x7f089416ada0 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17827fc640 1 --2- 10.20.193.40:0/4180093076 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1784133420 0x7f1784131760 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f176c00e580 tx=0x7f176c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17637fe640 10 client.?.objecter ms_handle_connect 0x7f1784133420 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17637fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0893fff640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f089405d1a0 0x7f0894158950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f08937fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 0x7f0894158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0893fff640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f089405d1a0 0x7f0894158950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:50934/0 (socket says 10.20.193.40:50934) 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0893fff640 1 -- 10.20.193.40:0/972668373 learned_addr learned my addr 10.20.193.40:0/972668373 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 librados: starting msgr at 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 librados: starting objecter 2026-02-24T17:25:10.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 Processor -- start 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 -- 10.20.193.40:0/866588365 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9c8126e20 msgr2=0x7ff9c8129460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 --2- 10.20.193.40:0/866588365 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff9c8126e20 0x7ff9c8129460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 -- 10.20.193.40:0/866588365 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff9b00048d0 msgr2=0x7ff9c8162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0898e94640 1 --2- 10.20.193.40:0/972668373 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f089416ada0 0x7f0894139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197c004020 con 0x7f19880b4320 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 -- 10.20.193.40:0/303361132 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19880b0490 con 0x7f19880b4320 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f197c0043f0 con 0x7f19880b4320 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 10 client.4413.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 -- 10.20.193.40:0/303361132 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19880b0a50 con 0x7f19880b4320 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f198d3bb640 1 librados: init done 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 --2- 10.20.193.40:0/866588365 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff9b00048d0 0x7ff9c8162ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 -- 10.20.193.40:0/866588365 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c8161960 con 0x7ff9c81648c0 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f176c019070 con 0x7f1784133420 2026-02-24T17:25:10.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9cd622640 1 --2- 10.20.193.40:0/866588365 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9c81648c0 0x7ff9c8128f20 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9bc002770 tx=0x7ff9b0005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 librados: starting msgr at 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 librados: starting objecter 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 Processor -- start 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9b67fc640 10 client.?.objecter ms_handle_connect 0x7ff9c81648c0 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9b67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc3662e3640 1 --2- 10.20.193.40:0/1670086775 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc360167ed0 0x7fc360168300 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=13361023110996512881 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3600b7410 tx=0x7fc35c01d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96be3bacebb5071 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc364ae0640 1 -- 10.20.193.40:0/1670086775 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc35c0b3070 con 0x7fc360167ed0 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9bc002d80 con 0x7ff9c81648c0 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc364ae0640 1 -- 10.20.193.40:0/1670086775 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c0a6960 con 0x7fc360167ed0 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fc364ae0640 1 -- 10.20.193.40:0/1670086775 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc35c0a6d70 con 0x7fc360167ed0 2026-02-24T17:25:10.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c8161c40 con 0x7ff9c81648c0 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fd44c024050 con 0x7fd45c05d1a0 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 --2- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6800/397309233 conn(0x7fd42c074080 0x7fd42c094530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fd44c095a80 con 0x7fd45c05d1a0 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 10 client.4384.objecter ms_dispatch2 0x7fd45c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 3 client.4384.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 3 client.4384.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 10 client.4384.objecter checking command 1 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 --2- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6806/679060341 conn(0x7fd42c099fb0 0x7fd42c0ba3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 20 client.4384.objecter _get_session s=0x7fd42c099900 osd=3 3 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 20 client.4384.objecter put_session s=0x7fd42c099900 osd=3 3 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 15 client.4384.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 20 client.4384.objecter _get_session s=0x7fd42c099900 osd=3 3 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 20 client.4384.objecter get_session s=0x7fd42c099900 osd=3 3 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 15 client.4384.objecter _session_command_op_assign 3 1 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 20 client.4384.objecter put_session s=0x7fd42c099900 osd=3 4 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 10 client.4384.objecter _send_command 1 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 --> v2:10.20.193.120:6806/679060341 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd42c0baa70 con 0x7fd42c099fb0 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 20 client.4384.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd44c095e70 con 0x7fd45c05d1a0 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 10 client.4425.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c8162200 con 0x7ff9c81648c0 2026-02-24T17:25:10.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9d00ae640 1 librados: init done 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc005470 con 0x7ff9c81648c0 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- start start 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 librados: setting wanted keys 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 librados: calling monclient init 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa2b4054260 0x7fa2b41679a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa2b415d020 0x7fa2b4158830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa2b415d3f0 0x7fa2b416a5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b405c660 con 0x7fa2b415d020 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b4054b70 con 0x7fa2b4054260 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2bad12640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b405c7e0 con 0x7fa2b415d3f0 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9bc0a89f0 con 0x7ff9c81648c0 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- start start 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 librados: setting wanted keys 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 librados: calling monclient init 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14005a20 0x7efc2c13adf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2b8a87640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa2b4054260 0x7fa2b41679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efc2c13b330 0x7efc2c13cce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc2c13d220 0x7efc2c161af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c1643d0 con 0x7efc2c13d220 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c164250 con 0x7efc2c13b330 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc33e29640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c164550 con 0x7efc14005a20 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2b8a87640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa2b4054260 0x7fa2b41679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:50936/0 (socket says 10.20.193.40:50936) 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2b8a87640 1 -- 10.20.193.40:0/557134851 learned_addr learned my addr 10.20.193.40:0/557134851 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0068d0 con 0x7f1784133420 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f176c006ce0 con 0x7f1784133420 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19657fa640 10 client.4413.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19657fa640 15 client.4413.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19657fa640 20 client.4413.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19657fa640 10 client.4413.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1948003900 con 0x7f19880b4320 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f197c003710 con 0x7f19880b4320 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4611f3640 1 --2- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6800/397309233 conn(0x7fd42c074080 0x7fd42c094530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fd4621f5640 1 --2- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6806/679060341 conn(0x7fd42c099fb0 0x7fd42c0ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7fa2b9288640 1 --2- 10.20.193.40:0/557134851 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa2b415d3f0 0x7fa2b416a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f08937fe640 1 -- 10.20.193.40:0/972668373 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f089416ada0 msgr2=0x7f0894139d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f08937fe640 1 --2- 10.20.193.40:0/972668373 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f089416ada0 0x7f0894139d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f08937fe640 1 -- 10.20.193.40:0/972668373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f089405d1a0 msgr2=0x7f0894158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f08937fe640 1 --2- 10.20.193.40:0/972668373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f089405d1a0 0x7f0894158950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f08937fe640 1 -- 10.20.193.40:0/972668373 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08941578b0 con 0x7f089405d570 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0893fff640 1 --2- 10.20.193.40:0/972668373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f089405d1a0 0x7f0894158950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc3239f640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc2c13d220 0x7efc2c161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc3239f640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc2c13d220 0x7efc2c161af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48798/0 (socket says 10.20.193.40:48798) 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc3239f640 1 -- 10.20.193.40:0/745309819 learned_addr learned my addr 10.20.193.40:0/745309819 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f08937fe640 1 --2- 10.20.193.40:0/972668373 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 0x7f0894158e90 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08840047a0 tx=0x7f088400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0890ff9640 10 client.?.objecter ms_handle_connect 0x7f089405d570 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0890ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0884016070 con 0x7f089405d570 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08840044a0 con 0x7f089405d570 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08840029e0 con 0x7f089405d570 2026-02-24T17:25:10.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0894157b90 con 0x7f089405d570 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7efc31b9e640 1 --2- 10.20.193.40:0/745309819 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14005a20 0x7efc2c13adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 10 client.4428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0894158150 con 0x7f089405d570 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 1 librados: init done 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc3139d640 1 --2- 10.20.193.40:0/745309819 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efc2c13b330 0x7efc2c13cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 1 --2- 10.20.193.40:0/303361132 >> v2:10.20.193.120:6800/397309233 conn(0x7f1954074100 0x7f19540945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9d00ae640 10 client.4425.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9d00ae640 15 client.4425.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9d00ae640 20 client.4425.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9d00ae640 10 client.4425.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9c8057810 con 0x7ff9c81648c0 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2b9288640 1 -- 10.20.193.40:0/557134851 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa2b4054260 msgr2=0x7fa2b41679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2b9288640 1 --2- 10.20.193.40:0/557134851 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa2b4054260 0x7fa2b41679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2b9288640 1 -- 10.20.193.40:0/557134851 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa2b415d020 msgr2=0x7fa2b4158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2b9288640 1 --2- 10.20.193.40:0/557134851 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa2b415d020 0x7fa2b4158830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2b9288640 1 -- 10.20.193.40:0/557134851 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b4168350 con 0x7fa2b415d3f0 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f197c130760 con 0x7f19880b4320 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 10 client.4413.objecter ms_dispatch2 0x7f1988000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 3 client.4413.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 3 client.4413.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 10 client.4413.objecter checking command 1 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 1 --2- 10.20.193.40:0/303361132 >> v2:10.20.193.94:6808/2000550170 conn(0x7f195409a030 0x7f19540ba460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 20 client.4413.objecter _get_session s=0x7f1954099980 osd=1 3 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 20 client.4413.objecter put_session s=0x7f1954099980 osd=1 3 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 15 client.4413.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 20 client.4413.objecter _get_session s=0x7f1954099980 osd=1 3 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 20 client.4413.objecter get_session s=0x7f1954099980 osd=1 3 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 15 client.4413.objecter _session_command_op_assign 1 1 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 20 client.4413.objecter put_session s=0x7f1954099980 osd=1 4 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 10 client.4413.objecter _send_command 1 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 --> v2:10.20.193.94:6808/2000550170 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f197c007e50 con 0x7f195409a030 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 20 client.4413.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f197c137050 con 0x7f19880b4320 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1784132380 con 0x7f1784133420 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1784132940 con 0x7f1784133420 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.743+0000 7f17895fa640 1 librados: init done 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4611f3640 1 --2- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6800/397309233 conn(0x7fd42c074080 0x7fd42c094530 secure :-1 s=READY pgs=67 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd45c166bc0 tx=0x7fd444008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4527fc640 10 client.4384.objecter ms_handle_connect 0x7fd42c074080 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f1986ffd640 1 --2- 10.20.193.40:0/303361132 >> v2:10.20.193.120:6800/397309233 conn(0x7f1954074100 0x7f19540945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- 10.20.193.40:0/1670086775 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc360167ed0 msgr2=0x7fc360168300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 --2- 10.20.193.40:0/1670086775 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc360167ed0 0x7fc360168300 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=13361023110996512881 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3600b7410 tx=0x7fc35c01d990 comp rx=0 tx=0).stop 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17895fa640 10 client.4422.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17895fa640 15 client.4422.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17895fa640 20 client.4422.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17895fa640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2b9288640 1 --2- 10.20.193.40:0/557134851 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa2b415d3f0 0x7fa2b416a5d0 secure :-1 s=READY pgs=76 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b40551d0 tx=0x7fa2b001cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 10 client.?.objecter ms_handle_connect 0x7fa2b415d3f0 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1784057810 con 0x7f1784133420 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc31b9e640 1 -- 10.20.193.40:0/745309819 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efc2c13b330 msgr2=0x7efc2c13cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc31b9e640 1 --2- 10.20.193.40:0/745309819 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efc2c13b330 0x7efc2c13cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc31b9e640 1 -- 10.20.193.40:0/745309819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc2c13d220 msgr2=0x7efc2c161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc31b9e640 1 --2- 10.20.193.40:0/745309819 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efc2c13d220 0x7efc2c161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc31b9e640 1 -- 10.20.193.40:0/745309819 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c13d760 con 0x7efc14005a20 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19877fe640 1 --2- 10.20.193.40:0/303361132 >> v2:10.20.193.94:6808/2000550170 conn(0x7f195409a030 0x7f19540ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4621f5640 1 --2- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6806/679060341 conn(0x7fd42c099fb0 0x7fd42c0ba3e0 crc :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4527fc640 10 client.4384.objecter ms_handle_connect 0x7fd42c099fb0 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- 10.20.193.40:0/1670086775 shutdown_connections 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 --2- 10.20.193.40:0/1670086775 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc360167ed0 0x7fc360168300 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=13361023110996512881 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 --2- 10.20.193.40:0/1670086775 >> v2:10.20.193.94:3300/0 conn(0x7fc36015b530 0x7fc3600b3600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- 10.20.193.40:0/1670086775 >> 10.20.193.40:0/1670086775 conn(0x7fc360054690 msgr2=0x7fc360054a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2b00b5070 con 0x7fa2b415d3f0 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b00c2070 con 0x7fa2b415d3f0 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2b00bc480 con 0x7fa2b415d3f0 2026-02-24T17:25:10.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- 10.20.193.40:0/1670086775 shutdown_connections 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- 10.20.193.40:0/1670086775 wait complete. 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 1 -- 10.20.193.40:0/557134851 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b4168630 con 0x7fa2b415d3f0 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 10 client.4409.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 1 -- 10.20.193.40:0/557134851 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b4168bf0 con 0x7fa2b415d3f0 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 1 librados: init done 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f1986ffd640 1 --2- 10.20.193.40:0/303361132 >> v2:10.20.193.120:6800/397309233 conn(0x7f1954074100 0x7f19540945b0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1970004780 tx=0x7f1970008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 10 client.4413.objecter ms_handle_connect 0x7f1954074100 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc31b9e640 1 --2- 10.20.193.40:0/745309819 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14005a20 0x7efc2c13adf0 secure :-1 s=READY pgs=77 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc1c00eb70 tx=0x7efc1c00c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19877fe640 1 --2- 10.20.193.40:0/303361132 >> v2:10.20.193.94:6808/2000550170 conn(0x7f195409a030 0x7f19540ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 10 client.4413.objecter ms_handle_connect 0x7f195409a030 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 10 client.?.objecter ms_handle_connect 0x7efc14005a20 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 10 client.4409.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 15 client.4409.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.806 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 20 client.4409.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 10 client.4409.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2bad12640 1 -- 10.20.193.40:0/557134851 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2b42041b0 con 0x7fa2b415d3f0 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc1c00cde0 con 0x7efc14005a20 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2c13da40 con 0x7efc14005a20 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 10 client.4412.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2c1612f0 con 0x7efc14005a20 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 1 librados: init done 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1c018070 con 0x7efc14005a20 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc1c01d680 con 0x7efc14005a20 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 librados: starting msgr at 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 librados: starting objecter 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 Processor -- start 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- start start 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 librados: setting wanted keys 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 librados: calling monclient init 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 10 client.4412.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 15 client.4412.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 20 client.4412.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 10 client.4412.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc2c13dd20 con 0x7efc14005a20 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 <== osd.1 v2:10.20.193.94:6808/2000550170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f197c007e50 con 0x7f195409a030 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 10 client.4413.objecter ms_dispatch2 0x7f1988000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 10 client.4413.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 20 client.4413.objecter put_session s=0x7f1954099980 osd=1 4 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f19677fe640 15 client.4413.objecter _session_command_op_remove 1 1 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 <== osd.3 v2:10.20.193.120:6806/679060341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fd42c0baa70 con 0x7fd42c099fb0 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4527fc640 10 client.4384.objecter ms_dispatch2 0x7fd45c000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4527fc640 10 client.4384.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4527fc640 20 client.4384.objecter put_session s=0x7fd42c099900 osd=3 4 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fd4527fc640 15 client.4384.objecter _session_command_op_remove 3 1 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc36015b160 0x7fc360177f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc36015b530 0x7fc3601600c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fa2b00ce070 con 0x7fa2b415d3f0 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc360167ed0 0x7fc360161b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc3600b8e00 con 0x7fc36015b160 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc360168840 con 0x7fc36015b530 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc3600b4fc0 con 0x7fc360167ed0 2026-02-24T17:25:10.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 10 client.4428.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 15 client.4428.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 20 client.4428.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 10 client.4428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0854003900 con 0x7f089405d570 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7ff9bc0c2030 con 0x7ff9c81648c0 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 --2- 10.20.193.40:0/557134851 >> v2:10.20.193.120:6800/397309233 conn(0x7fa284074170 0x7fa284094620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fa2b0135fe0 con 0x7fa2b415d3f0 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 10 client.4409.objecter ms_dispatch2 0x7fa2b4000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 3 client.4409.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 3 client.4409.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 10 client.4409.objecter checking command 1 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc36015b160 0x7fc360177f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc36015b160 0x7fc360177f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48814/0 (socket says 10.20.193.40:48814) 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 -- 10.20.193.40:0/2590570348 learned_addr learned my addr 10.20.193.40:0/2590570348 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 --2- 10.20.193.40:0/557134851 >> v2:10.20.193.109:6809/2048261086 conn(0x7fa28409a0a0 0x7fa2840ba4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 20 client.4409.objecter _get_session s=0x7fa2840999f0 osd=6 3 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 20 client.4409.objecter put_session s=0x7fa2840999f0 osd=6 3 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 15 client.4409.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc3662e3640 1 --2- 10.20.193.40:0/2590570348 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc360167ed0 0x7fc360161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 -- 10.20.193.40:0/2590570348 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc360167ed0 msgr2=0x7fc360161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 20 client.4409.objecter _get_session s=0x7fa2840999f0 osd=6 3 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 20 client.4409.objecter get_session s=0x7fa2840999f0 osd=6 3 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 15 client.4409.objecter _session_command_op_assign 6 1 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 20 client.4409.objecter put_session s=0x7fa2840999f0 osd=6 4 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 10 client.4409.objecter _send_command 1 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 --2- 10.20.193.40:0/2590570348 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc360167ed0 0x7fc360161b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 -- 10.20.193.40:0/2590570348 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc36015b530 msgr2=0x7fc3601600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 --2- 10.20.193.40:0/2590570348 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc36015b530 0x7fc3601600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 -- 10.20.193.40:0/2590570348 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3601779d0 con 0x7fc36015b160 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 --> v2:10.20.193.109:6809/2048261086 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2840bab60 con 0x7fa28409a0a0 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 20 client.4409.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.810 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2b0136350 con 0x7fa2b415d3f0 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc365ae2640 1 --2- 10.20.193.40:0/2590570348 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc36015b160 0x7fc360177f60 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc35000c4d0 tx=0x7fc35000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2abfff640 1 --2- 10.20.193.40:0/557134851 >> v2:10.20.193.109:6809/2048261086 conn(0x7fa28409a0a0 0x7fa2840ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 1 --2- 10.20.193.40:0/866588365 >> v2:10.20.193.120:6800/397309233 conn(0x7ff9980740f0 0x7ff9980945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc34e7fc640 10 client.?.objecter ms_handle_connect 0x7fc36015b160 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc34e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2b8a87640 1 --2- 10.20.193.40:0/557134851 >> v2:10.20.193.120:6800/397309233 conn(0x7fa284074170 0x7fa284094620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc350016020 con 0x7fc36015b160 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7ff9bc0b6070 con 0x7ff9c81648c0 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 10 client.4425.objecter ms_dispatch2 0x7ff9c8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 3 client.4425.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.811 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 3 client.4425.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7efc1c03c9d0 con 0x7efc14005a20 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc350005240 con 0x7fc36015b160 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3601776f0 con 0x7fc36015b160 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 10 client.4425.objecter checking command 1 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 10 client.4434.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 1 --2- 10.20.193.40:0/866588365 >> v2:10.20.193.109:6800/1855643564 conn(0x7ff99809a020 0x7ff9980ba450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 20 client.4425.objecter _get_session s=0x7ff998099970 osd=2 3 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f176c004070 con 0x7f1784133420 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 1 --2- 10.20.193.40:0/4180093076 >> v2:10.20.193.120:6800/397309233 conn(0x7f17500741e0 0x7f1750094690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f176c010040 con 0x7f1784133420 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 10 client.4422.objecter ms_dispatch2 0x7f1784000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 3 client.4422.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 3 client.4422.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 10 client.4422.objecter checking command 1 2026-02-24T17:25:10.812 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 1 --2- 10.20.193.40:0/4180093076 >> v2:10.20.193.94:6800/3536923368 conn(0x7f175009a110 0x7f17500ba540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 20 client.4425.objecter put_session s=0x7ff998099970 osd=2 3 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 20 client.4422.objecter _get_session s=0x7f1750099a60 osd=9 3 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 20 client.4422.objecter put_session s=0x7f1750099a60 osd=9 3 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 15 client.4422.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 20 client.4422.objecter _get_session s=0x7f1750099a60 osd=9 3 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 20 client.4422.objecter get_session s=0x7f1750099a60 osd=9 3 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 15 client.4422.objecter _session_command_op_assign 9 1 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 15 client.4425.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 20 client.4422.objecter put_session s=0x7f1750099a60 osd=9 4 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 10 client.4422.objecter _send_command 1 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 --> v2:10.20.193.94:6800/3536923368 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17500babd0 con 0x7f175009a110 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 20 client.4422.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f176c09c050 con 0x7f1784133420 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 20 client.4425.objecter _get_session s=0x7ff998099970 osd=2 3 2026-02-24T17:25:10.813 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f1782ffd640 1 --2- 10.20.193.40:0/4180093076 >> v2:10.20.193.120:6800/397309233 conn(0x7f17500741e0 0x7f1750094690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 20 client.4425.objecter get_session s=0x7ff998099970 osd=2 3 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 15 client.4425.objecter _session_command_op_assign 2 1 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 20 client.4425.objecter put_session s=0x7ff998099970 osd=2 4 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 10 client.4425.objecter _send_command 1 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 --> v2:10.20.193.109:6800/1855643564 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9bc0c0e70 con 0x7ff99809a020 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 20 client.4425.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff9bc139050 con 0x7ff9c81648c0 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9ce624640 1 --2- 10.20.193.40:0/866588365 >> v2:10.20.193.109:6800/1855643564 conn(0x7ff99809a020 0x7ff9980ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17837fe640 1 --2- 10.20.193.40:0/4180093076 >> v2:10.20.193.94:6800/3536923368 conn(0x7f175009a110 0x7f17500ba540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 --2- 10.20.193.40:0/745309819 >> v2:10.20.193.120:6800/397309233 conn(0x7efbfc074100 0x7efbfc0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7efc1c010040 con 0x7efc14005a20 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 10 client.4412.objecter ms_dispatch2 0x7efc2c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 3 client.4412.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 3 client.4412.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2abfff640 1 --2- 10.20.193.40:0/557134851 >> v2:10.20.193.109:6809/2048261086 conn(0x7fa28409a0a0 0x7fa2840ba4d0 crc :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 10 client.4409.objecter ms_handle_connect 0x7fa28409a0a0 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2b8a87640 1 --2- 10.20.193.40:0/557134851 >> v2:10.20.193.120:6800/397309233 conn(0x7fa284074170 0x7fa284094620 secure :-1 s=READY pgs=69 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2a4009580 tx=0x7fa2a4009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.814 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fa2a97fa640 10 client.4409.objecter ms_handle_connect 0x7fa284074170 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 10 client.4412.objecter checking command 1 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 --2- 10.20.193.40:0/745309819 >> v2:10.20.193.40:6812/730213184 conn(0x7efbfc09a030 0x7efbfc0ba460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 20 client.4412.objecter _get_session s=0x7efbfc099980 osd=12 3 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 20 client.4412.objecter put_session s=0x7efbfc099980 osd=12 3 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 15 client.4412.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 20 client.4412.objecter _get_session s=0x7efbfc099980 osd=12 3 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 20 client.4412.objecter get_session s=0x7efbfc099980 osd=12 3 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 15 client.4412.objecter _session_command_op_assign 12 1 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 20 client.4412.objecter put_session s=0x7efbfc099980 osd=12 4 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 10 client.4412.objecter _send_command 1 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 --> v2:10.20.193.40:6812/730213184 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efbfc0baaf0 con 0x7efbfc09a030 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 20 client.4412.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efc1c096130 con 0x7efc14005a20 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3500068d0 con 0x7fc36015b160 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 10 client.4422.objecter ms_handle_connect 0x7f17500741e0 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f1782ffd640 1 --2- 10.20.193.40:0/4180093076 >> v2:10.20.193.120:6800/397309233 conn(0x7f17500741e0 0x7f1750094690 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1778007bf0 tx=0x7f1778006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36015f5e0 con 0x7fc36015b160 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7fc367d6d640 1 librados: init done 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc3239f640 1 --2- 10.20.193.40:0/745309819 >> v2:10.20.193.40:6812/730213184 conn(0x7efbfc09a030 0x7efbfc0ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.815 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17837fe640 1 --2- 10.20.193.40:0/4180093076 >> v2:10.20.193.94:6800/3536923368 conn(0x7f175009a110 0x7f17500ba540 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f17637fe640 10 client.4422.objecter ms_handle_connect 0x7f175009a110 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7efc3139d640 1 --2- 10.20.193.40:0/745309819 >> v2:10.20.193.120:6800/397309233 conn(0x7efbfc074100 0x7efbfc0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9b67fc640 10 client.4425.objecter ms_handle_connect 0x7ff99809a020 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7ff9ce624640 1 --2- 10.20.193.40:0/866588365 >> v2:10.20.193.109:6800/1855643564 conn(0x7ff99809a020 0x7ff9980ba450 crc :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7ff9cde23640 1 --2- 10.20.193.40:0/866588365 >> v2:10.20.193.120:6800/397309233 conn(0x7ff9980740f0 0x7ff9980945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc3239f640 1 --2- 10.20.193.40:0/745309819 >> v2:10.20.193.40:6812/730213184 conn(0x7efbfc09a030 0x7efbfc0ba460 crc :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fc350006a70 con 0x7fc36015b160 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc1a7fc640 10 client.4412.objecter ms_handle_connect 0x7efbfc09a030 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc367d6d640 10 client.4434.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc367d6d640 15 client.4434.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc367d6d640 20 client.4434.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc367d6d640 10 client.4434.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.816 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc36003b110 con 0x7fc36015b160 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f0884002b80 con 0x7f089405d570 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.747+0000 7f0890ff9640 1 --2- 10.20.193.40:0/972668373 >> v2:10.20.193.120:6800/397309233 conn(0x7f086407cb00 0x7f086409cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f0884096010 con 0x7f089405d570 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 10 client.4428.objecter ms_dispatch2 0x7f0894000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 3 client.4428.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 3 client.4428.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 10 client.4428.objecter checking command 1 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 1 --2- 10.20.193.40:0/972668373 >> v2:10.20.193.40:6808/1991872075 conn(0x7f08640a2a30 0x7f08640c2e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 20 client.4428.objecter _get_session s=0x7f08640a2380 osd=8 3 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 20 client.4428.objecter put_session s=0x7f08640a2380 osd=8 3 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 15 client.4428.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 20 client.4428.objecter _get_session s=0x7f08640a2380 osd=8 3 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 20 client.4428.objecter get_session s=0x7f08640a2380 osd=8 3 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 15 client.4428.objecter _session_command_op_assign 8 1 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 20 client.4428.objecter put_session s=0x7f08640a2380 osd=8 4 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 10 client.4428.objecter _send_command 1 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 --> v2:10.20.193.40:6808/1991872075 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08640c34f0 con 0x7f08640a2a30 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 20 client.4428.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0884096400 con 0x7f089405d570 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0893fff640 1 --2- 10.20.193.40:0/972668373 >> v2:10.20.193.120:6800/397309233 conn(0x7f086407cb00 0x7f086409cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 <== osd.6 v2:10.20.193.109:6809/2048261086 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fa2840bab60 con 0x7fa28409a0a0 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fa2a97fa640 10 client.4409.objecter ms_dispatch2 0x7fa2b4000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fa2a97fa640 10 client.4409.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fa2a97fa640 20 client.4409.objecter put_session s=0x7fa2840999f0 osd=6 4 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fa2a97fa640 15 client.4409.objecter _session_command_op_remove 6 1 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0898e94640 1 --2- 10.20.193.40:0/972668373 >> v2:10.20.193.40:6808/1991872075 conn(0x7f08640a2a30 0x7f08640c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.817 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc3139d640 1 --2- 10.20.193.40:0/745309819 >> v2:10.20.193.120:6800/397309233 conn(0x7efbfc074100 0x7efbfc0945b0 secure :-1 s=READY pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc20002410 tx=0x7efc20003850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc1a7fc640 10 client.4412.objecter ms_handle_connect 0x7efbfc074100 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 <== osd.9 v2:10.20.193.94:6800/3536923368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f17500babd0 con 0x7f175009a110 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f17637fe640 10 client.4422.objecter ms_dispatch2 0x7f1784000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f17637fe640 10 client.4422.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f17637fe640 20 client.4422.objecter put_session s=0x7f1750099a60 osd=9 4 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f17637fe640 15 client.4422.objecter _session_command_op_remove 9 1 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 1 --2- 10.20.193.40:0/2590570348 >> v2:10.20.193.120:6800/397309233 conn(0x7fc330074240 0x7fc3300946f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 <== osd.2 v2:10.20.193.109:6800/1855643564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7ff9bc0c0e70 con 0x7ff99809a020 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7ff9b67fc640 10 client.4425.objecter ms_dispatch2 0x7ff9c8000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7ff9b67fc640 10 client.4425.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7ff9b67fc640 20 client.4425.objecter put_session s=0x7ff998099970 osd=2 4 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7ff9b67fc640 15 client.4425.objecter _session_command_op_remove 2 1 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fc350095050 con 0x7fc36015b160 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 10 client.4434.objecter ms_dispatch2 0x7fc360000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 3 client.4434.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 3 client.4434.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7ff9b67fc640 10 client.4425.objecter ms_handle_connect 0x7ff9980740f0 2026-02-24T17:25:10.818 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7ff9cde23640 1 --2- 10.20.193.40:0/866588365 >> v2:10.20.193.120:6800/397309233 conn(0x7ff9980740f0 0x7ff9980945a0 secure :-1 s=READY pgs=72 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9c8161140 tx=0x7ff9b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 10 client.4428.objecter ms_handle_connect 0x7f08640a2a30 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0898e94640 1 --2- 10.20.193.40:0/972668373 >> v2:10.20.193.40:6808/1991872075 conn(0x7f08640a2a30 0x7f08640c2e60 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 10 client.4434.objecter checking command 1 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 1 --2- 10.20.193.40:0/2590570348 >> v2:10.20.193.109:6801/1905173416 conn(0x7fc33009a1d0 0x7fc3300ba600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 20 client.4434.objecter _get_session s=0x7fc330099b20 osd=14 3 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 20 client.4434.objecter put_session s=0x7fc330099b20 osd=14 3 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 15 client.4434.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 20 client.4434.objecter _get_session s=0x7fc330099b20 osd=14 3 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 20 client.4434.objecter get_session s=0x7fc330099b20 osd=14 3 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 15 client.4434.objecter _session_command_op_assign 14 1 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 20 client.4434.objecter put_session s=0x7fc330099b20 osd=14 4 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 10 client.4434.objecter _send_command 1 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 --> v2:10.20.193.109:6801/1905173416 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc350005240 con 0x7fc33009a1d0 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 20 client.4434.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc35009a060 con 0x7fc36015b160 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 10 client.4428.objecter ms_handle_connect 0x7f086407cb00 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0893fff640 1 --2- 10.20.193.40:0/972668373 >> v2:10.20.193.120:6800/397309233 conn(0x7f086407cb00 0x7f086409cfb0 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0880002770 tx=0x7f0880009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 <== osd.8 v2:10.20.193.40:6808/1991872075 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f08640c34f0 con 0x7f08640a2a30 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 10 client.4428.objecter ms_dispatch2 0x7f0894000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 10 client.4428.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 20 client.4428.objecter put_session s=0x7f08640a2380 osd=8 4 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7f0890ff9640 15 client.4428.objecter _session_command_op_remove 8 1 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc3652e1640 1 --2- 10.20.193.40:0/2590570348 >> v2:10.20.193.120:6800/397309233 conn(0x7fc330074240 0x7fc3300946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 <== osd.12 v2:10.20.193.40:6812/730213184 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7efbfc0baaf0 con 0x7efbfc09a030 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc1a7fc640 10 client.4412.objecter ms_dispatch2 0x7efc2c000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc1a7fc640 10 client.4412.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc3662e3640 1 --2- 10.20.193.40:0/2590570348 >> v2:10.20.193.109:6801/1905173416 conn(0x7fc33009a1d0 0x7fc3300ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc1a7fc640 20 client.4412.objecter put_session s=0x7efbfc099980 osd=12 4 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7efc1a7fc640 15 client.4412.objecter _session_command_op_remove 12 1 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc3662e3640 1 --2- 10.20.193.40:0/2590570348 >> v2:10.20.193.109:6801/1905173416 conn(0x7fc33009a1d0 0x7fc3300ba600 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 10 client.4434.objecter ms_handle_connect 0x7fc33009a1d0 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 10 client.4434.objecter ms_handle_connect 0x7fc330074240 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc3652e1640 1 --2- 10.20.193.40:0/2590570348 >> v2:10.20.193.120:6800/397309233 conn(0x7fc330074240 0x7fc3300946f0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3601564c0 tx=0x7fc354008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 <== osd.14 v2:10.20.193.109:6801/1905173416 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fc350005240 con 0x7fc33009a1d0 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 10 client.4434.objecter ms_dispatch2 0x7fc360000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 10 client.4434.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 20 client.4434.objecter put_session s=0x7fc330099b20 osd=14 4 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.751+0000 7fc34e7fc640 15 client.4434.objecter _session_command_op_remove 14 1 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 10 client.4384.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 15 client.4384.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 20 client.4384.objecter _get_session s=0x7fd42c099900 osd=3 3 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 20 client.4384.objecter put_session s=0x7fd42c099900 osd=3 3 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 20 client.4384.objecter _get_session s=0x7fd42c099900 osd=3 3 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 15 client.4384.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 20 client.4384.objecter get_session s=0x7fd42c099900 osd=3 3 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 15 client.4384.objecter _session_command_op_assign 3 2 2026-02-24T17:25:10.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 20 client.4384.objecter put_session s=0x7fd42c099900 osd=3 4 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 10 client.4384.objecter _send_command 2 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 --> v2:10.20.193.120:6806/679060341 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd45c057810 con 0x7fd42c099fb0 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd4527fc640 1 -- 10.20.193.40:0/625137846 <== osd.3 v2:10.20.193.120:6806/679060341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd45c057810 con 0x7fd42c099fb0 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd4527fc640 10 client.4384.objecter ms_dispatch2 0x7fd45c000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd4527fc640 10 client.4384.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd4527fc640 20 client.4384.objecter put_session s=0x7fd42c099900 osd=3 4 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd4527fc640 15 client.4384.objecter _session_command_op_remove 3 2 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 10 librados: watch_flush enter 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 10 librados: watch_flush exit 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 10 client.4384.objecter close_session for osd.3 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6806/679060341 conn(0x7fd42c099fb0 msgr2=0x7fd42c0ba3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 1 --2- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6806/679060341 conn(0x7fd42c099fb0 0x7fd42c0ba3e0 crc :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 20 client.4384.objecter put_session s=0x7fd42c099900 osd=3 1 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 20 client.4384.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.755+0000 7fd463c7f640 10 client.4384.objecter successfully canceled tick 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6800/397309233 conn(0x7fd42c074080 msgr2=0x7fd42c094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 --2- 10.20.193.40:0/625137846 >> v2:10.20.193.120:6800/397309233 conn(0x7fd42c074080 0x7fd42c094530 secure :-1 s=READY pgs=67 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd45c166bc0 tx=0x7fd444008040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd45c05d1a0 msgr2=0x7fd45c165d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 --2- 10.20.193.40:0/625137846 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd45c05d1a0 0x7fd45c165d50 secure :-1 s=READY pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd44c00c500 tx=0x7fd44c00c9c0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd4621f5640 1 -- 10.20.193.40:0/625137846 reap_dead start 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 shutdown_connections 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 >> 10.20.193.40:0/625137846 conn(0x7fd45c0bd200 msgr2=0x7fd45c15b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 shutdown_connections 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 -- 10.20.193.40:0/625137846 wait complete. 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fd463c7f640 1 librados: shutdown 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff0719f9640 1 Processor -- start 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff0719f9640 1 -- start start 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9ab05a6640 1 Processor -- start 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9ab05a6640 1 -- start start 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 10 client.4413.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 15 client.4413.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 20 client.4413.objecter _get_session s=0x7f1954099980 osd=1 3 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 20 client.4413.objecter put_session s=0x7f1954099980 osd=1 3 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 20 client.4413.objecter _get_session s=0x7f1954099980 osd=1 3 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 15 client.4413.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 20 client.4413.objecter get_session s=0x7f1954099980 osd=1 3 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 15 client.4413.objecter _session_command_op_assign 1 2 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 20 client.4413.objecter put_session s=0x7f1954099980 osd=1 4 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 10 client.4413.objecter _send_command 2 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 --> v2:10.20.193.94:6808/2000550170 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1948002a20 con 0x7f195409a030 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff0719f9640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7ff06c168930 0x7ff06c0b31d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff0719f9640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06c168d90 con 0x7ff06c15b290 2026-02-24T17:25:10.822 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff0719f9640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06c0b3b50 con 0x7ff06c0b3710 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff0719f9640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff06c165880 con 0x7ff06c168930 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19677fe640 1 -- 10.20.193.40:0/303361132 <== osd.1 v2:10.20.193.94:6808/2000550170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1948002a20 con 0x7f195409a030 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19677fe640 10 client.4413.objecter ms_dispatch2 0x7f1988000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19677fe640 10 client.4413.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19677fe640 20 client.4413.objecter put_session s=0x7f1954099980 osd=1 4 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19677fe640 15 client.4413.objecter _session_command_op_remove 1 2 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06affd640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7ff06c15b290 0x7ff06c165d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45672/0 (socket says 10.20.193.40:45672) 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06affd640 1 -- 10.20.193.40:0/3771472023 learned_addr learned my addr 10.20.193.40:0/3771472023 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 10 librados: watch_flush enter 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 10 librados: watch_flush exit 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/3771472023 >> v2:10.20.193.94:3300/0 conn(0x7ff06c168930 0x7ff06c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 10 client.4413.objecter close_session for osd.1 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 >> v2:10.20.193.94:6808/2000550170 conn(0x7f195409a030 msgr2=0x7f19540ba460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 --2- 10.20.193.40:0/303361132 >> v2:10.20.193.94:6808/2000550170 conn(0x7f195409a030 0x7f19540ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 20 client.4413.objecter put_session s=0x7f1954099980 osd=1 1 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 20 client.4413.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 10 client.4413.objecter successfully canceled tick 2026-02-24T17:25:10.823 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 >> v2:10.20.193.120:6800/397309233 conn(0x7f1954074100 msgr2=0x7f19540945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 --2- 10.20.193.40:0/303361132 >> v2:10.20.193.120:6800/397309233 conn(0x7f1954074100 0x7f19540945b0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1970004780 tx=0x7f1970008040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19880b4320 msgr2=0x7f198817ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 --2- 10.20.193.40:0/303361132 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19880b4320 0x7f198817ad10 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f197c002410 tx=0x7f197c01adb0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137819162 0 0) 0x7ff06c168d90 con 0x7ff06c15b290 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19877fe640 1 -- 10.20.193.40:0/303361132 reap_dead start 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff058003620 con 0x7ff06c15b290 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 shutdown_connections 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 >> 10.20.193.40:0/303361132 conn(0x7f19880b8fd0 msgr2=0x7f198813e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1720218571 0 0) 0x7ff058003620 con 0x7ff06c15b290 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 >> v2:10.20.193.94:3300/0 conn(0x7ff06c168930 msgr2=0x7ff06c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 shutdown_connections 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 --2- 10.20.193.40:0/3771472023 >> v2:10.20.193.94:3300/0 conn(0x7ff06c168930 0x7ff06c0b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 >> v1:10.20.193.94:6789/0 conn(0x7ff06c0b3710 legacy=0x7ff06c164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c0b83c0 con 0x7ff06c15b290 2026-02-24T17:25:10.824 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7ff060002e80 con 0x7ff06c15b290 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 >> v1:10.20.193.40:6789/0 conn(0x7ff06c15b290 legacy=0x7ff06c165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff058003bf0 0x7ff058004000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff0580048d0 0x7ff058004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff058005480 0x7ff058065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c165880 con 0x7ff0580048d0 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff058066370 con 0x7ff058003bf0 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff058066570 con 0x7ff058005480 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 -- 10.20.193.40:0/303361132 wait complete. 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f19657fa640 1 librados: shutdown 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff0580048d0 0x7ff058004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9ab05a6640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f9aa805d1a0 0x7f9aa805d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06affd640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff058003bf0 0x7ff058004000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9ab05a6640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f9aa816ada0 0x7f9aa8166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9ab05a6640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa8167130 con 0x7f9aa80bc470 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9ab05a6640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa81673c0 con 0x7f9aa816ada0 2026-02-24T17:25:10.825 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06b7fe640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff058005480 0x7ff058065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06a7fc640 1 -- 10.20.193.40:0/3771472023 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff058005480 msgr2=0x7ff058065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aae31b640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f9aa805d1a0 0x7f9aa805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aae31b640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f9aa805d1a0 0x7f9aa805d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:51002/0 (socket says 10.20.193.40:51002) 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aae31b640 1 -- 10.20.193.40:0/1816744889 learned_addr learned my addr 10.20.193.40:0/1816744889 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aadb1a640 1 --2- 10.20.193.40:0/1816744889 >> v2:10.20.193.40:3300/0 conn(0x7f9aa816ada0 0x7f9aa8166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff058005480 0x7ff058065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06a7fc640 1 -- 10.20.193.40:0/3771472023 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff058003bf0 msgr2=0x7ff058004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff058003bf0 0x7ff058004000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9ab05a6640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa81676a0 con 0x7f9aa805d1a0 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06a7fc640 1 -- 10.20.193.40:0/3771472023 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff058003620 con 0x7ff0580048d0 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5f0e3640 1 Processor -- start 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06b7fe640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff058005480 0x7ff058065a90 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aad319640 1 -- 10.20.193.40:0/1816744889 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026276716 0 0) 0x7f9aa8167130 con 0x7f9aa80bc470 2026-02-24T17:25:10.826 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f79538c3640 1 Processor -- start 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5f0e3640 1 -- start start 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06b7fe640 1 -- 10.20.193.40:0/3771472023 reap_dead start 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aad319640 1 -- 10.20.193.40:0/1816744889 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a90003620 con 0x7f9aa80bc470 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f79538c3640 1 -- start start 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 10 client.4409.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 15 client.4409.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 20 client.4409.objecter _get_session s=0x7fa2840999f0 osd=6 3 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 20 client.4409.objecter put_session s=0x7fa2840999f0 osd=6 3 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 20 client.4409.objecter _get_session s=0x7fa2840999f0 osd=6 3 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 15 client.4409.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 20 client.4409.objecter get_session s=0x7fa2840999f0 osd=6 3 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 15 client.4409.objecter _session_command_op_assign 6 2 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aadb1a640 1 -- 10.20.193.40:0/1816744889 >> v2:10.20.193.109:3300/0 conn(0x7f9aa805d1a0 msgr2=0x7f9aa805d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aadb1a640 1 --2- 10.20.193.40:0/1816744889 >> v2:10.20.193.109:3300/0 conn(0x7f9aa805d1a0 0x7f9aa805d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 20 client.4409.objecter put_session s=0x7fa2840999f0 osd=6 4 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 10 client.4409.objecter _send_command 2 2026-02-24T17:25:10.827 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2bad12640 1 -- 10.20.193.40:0/557134851 --> v2:10.20.193.109:6809/2048261086 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2b403b110 con 0x7fa28409a0a0 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aadb1a640 1 -- 10.20.193.40:0/1816744889 >> v1:10.20.193.40:6789/0 conn(0x7f9aa80bc470 legacy=0x7f9aa80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aadb1a640 1 -- 10.20.193.40:0/1816744889 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa8167980 con 0x7f9aa816ada0 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2a97fa640 1 -- 10.20.193.40:0/557134851 <== osd.6 v2:10.20.193.109:6809/2048261086 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa29c009b00 con 0x7fa28409a0a0 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2a97fa640 10 client.4409.objecter ms_dispatch2 0x7fa2b4000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2a97fa640 10 client.4409.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2a97fa640 20 client.4409.objecter put_session s=0x7fa2840999f0 osd=6 4 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2a97fa640 15 client.4409.objecter _session_command_op_remove 6 2 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7624f80640 1 Processor -- start 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7624f80640 1 -- start start 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 10 librados: watch_flush enter 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 10 librados: watch_flush exit 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 10 client.4409.objecter close_session for osd.6 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 -- 10.20.193.40:0/557134851 >> v2:10.20.193.109:6809/2048261086 conn(0x7fa28409a0a0 msgr2=0x7fa2840ba4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 --2- 10.20.193.40:0/557134851 >> v2:10.20.193.109:6809/2048261086 conn(0x7fa28409a0a0 0x7fa2840ba4d0 crc :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 20 client.4409.objecter put_session s=0x7fa2840999f0 osd=6 1 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 20 client.4409.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.828 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 10 client.4409.objecter successfully canceled tick 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 -- 10.20.193.40:0/557134851 >> v2:10.20.193.120:6800/397309233 conn(0x7fa284074170 msgr2=0x7fa284094620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f79538c3640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f794c05d1a0 0x7f794c05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 --2- 10.20.193.40:0/557134851 >> v2:10.20.193.120:6800/397309233 conn(0x7fa284074170 0x7fa284094620 secure :-1 s=READY pgs=69 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2a4009580 tx=0x7fa2a4009290 comp rx=0 tx=0).stop 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f79538c3640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f794c16ada0 0x7f794c166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5f0e3640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f8f5805b560 0x7f8f5805c080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 -- 10.20.193.40:0/557134851 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa2b415d3f0 msgr2=0x7fa2b416a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5f0e3640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f8f58159660 0x7f8f58166040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5f0e3640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f5805ca00 con 0x7f8f5805c5c0 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5f0e3640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8f5805e490 con 0x7f8f58159660 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5f0e3640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8f5805b930 con 0x7f8f5805b560 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 --2- 10.20.193.40:0/557134851 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa2b415d3f0 0x7fa2b416a5d0 secure :-1 s=READY pgs=76 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2b40551d0 tx=0x7fa2b001cee0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f79538c3640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794c167130 con 0x7f794c0bc470 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f79538c3640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f794c1673c0 con 0x7f794c05d1a0 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f79538c3640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f794c1676a0 con 0x7f794c16ada0 2026-02-24T17:25:10.829 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa2b9288640 1 -- 10.20.193.40:0/557134851 reap_dead start 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7950e37640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f794c16ada0 0x7f794c166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7950e37640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f794c16ada0 0x7f794c166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:50998/0 (socket says 10.20.193.40:50998) 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7950e37640 1 -- 10.20.193.40:0/4137468480 learned_addr learned my addr 10.20.193.40:0/4137468480 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7951638640 1 --2- 10.20.193.40:0/4137468480 >> v2:10.20.193.40:3300/0 conn(0x7f794c05d1a0 0x7f794c05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5ce58640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f8f5805b560 0x7f8f5805c080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f4ffff640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f8f5805c5c0 0x7f8f58158f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45710/0 (socket says 10.20.193.40:45710) 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5ce58640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f8f5805b560 0x7f8f5805c080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51014/0 (socket says 10.20.193.40:51014) 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f4ffff640 1 -- 10.20.193.40:0/1745638394 learned_addr learned my addr 10.20.193.40:0/1745638394 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 -- 10.20.193.40:0/557134851 shutdown_connections 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 -- 10.20.193.40:0/557134851 >> 10.20.193.40:0/557134851 conn(0x7fa2b40b9b50 msgr2=0x7fa2b40b93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fcff0a3c640 1 Processor -- start 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 -- 10.20.193.40:0/557134851 shutdown_connections 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fcff0a3c640 1 -- start start 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 -- 10.20.193.40:0/557134851 wait complete. 2026-02-24T17:25:10.830 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7fa282ffd640 1 librados: shutdown 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7624f80640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f7620056c90 0x7f7620057060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7951638640 1 -- 10.20.193.40:0/4137468480 >> v2:10.20.193.94:3300/0 conn(0x7f794c16ada0 msgr2=0x7f794c166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7951638640 1 --2- 10.20.193.40:0/4137468480 >> v2:10.20.193.94:3300/0 conn(0x7f794c16ada0 0x7f794c166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7951638640 1 -- 10.20.193.40:0/4137468480 >> v1:10.20.193.40:6789/0 conn(0x7f794c0bc470 legacy=0x7f794c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7951638640 1 -- 10.20.193.40:0/4137468480 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794c167980 con 0x7f794c05d1a0 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7950e37640 1 --2- 10.20.193.40:0/4137468480 >> v2:10.20.193.94:3300/0 conn(0x7f794c16ada0 0x7f794c166bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7624f80640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f76200b4530 0x7f76200bc5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff0580048d0 0x7ff058004d40 secure :-1 s=READY pgs=114 gs=5 cs=0 l=1 c_cookie=14497414478364828012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff054009ad0 tx=0x7ff05401cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93129a8508a616c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7624f80640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f76200b4990 0x7f76200b7e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7624f80640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f76200b5cd0 con 0x7f76200b4990 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7624f80640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f76200b4e70 con 0x7f76200b4530 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f7624f80640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f76200b5150 con 0x7f7620056c90 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 10 client.4422.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 15 client.4422.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 20 client.4422.objecter _get_session s=0x7f1750099a60 osd=9 3 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5d659640 1 --2- 10.20.193.40:0/1745638394 >> v2:10.20.193.40:3300/0 conn(0x7f8f58159660 0x7f8f58166040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.831 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5ce58640 1 -- 10.20.193.40:0/1745638394 >> v2:10.20.193.40:3300/0 conn(0x7f8f58159660 msgr2=0x7f8f58166040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5ce58640 1 --2- 10.20.193.40:0/1745638394 >> v2:10.20.193.40:3300/0 conn(0x7f8f58159660 0x7f8f58166040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5ce58640 1 -- 10.20.193.40:0/1745638394 >> v1:10.20.193.40:6789/0 conn(0x7f8f5805c5c0 legacy=0x7f8f58158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 20 client.4422.objecter put_session s=0x7f1750099a60 osd=9 3 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 20 client.4422.objecter _get_session s=0x7f1750099a60 osd=9 3 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 15 client.4422.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 20 client.4422.objecter get_session s=0x7f1750099a60 osd=9 3 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 15 client.4422.objecter _session_command_op_assign 9 2 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 20 client.4422.objecter put_session s=0x7f1750099a60 osd=9 4 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 10 client.4422.objecter _send_command 2 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 --> v2:10.20.193.94:6800/3536923368 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f178403b110 con 0x7f175009a110 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f8f5ce58640 1 -- 10.20.193.40:0/1745638394 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f58162e40 con 0x7f8f5805b560 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f761dd74640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f76200b4530 0x7f76200bc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f761dd74640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f76200b4530 0x7f76200bc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51024/0 (socket says 10.20.193.40:51024) 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f761dd74640 1 -- 10.20.193.40:0/3046986858 learned_addr learned my addr 10.20.193.40:0/3046986858 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f761ed76640 1 --2- 10.20.193.40:0/3046986858 >> v2:10.20.193.40:3300/0 conn(0x7f76200b4990 0x7f76200b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f761e575640 1 --2- 10.20.193.40:0/3046986858 >> v2:10.20.193.109:3300/0 conn(0x7f7620056c90 0x7f7620057060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.759+0000 7f9aadb1a640 1 --2- 10.20.193.40:0/1816744889 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa816ada0 0x7f9aa8166bf0 secure :-1 s=READY pgs=115 gs=3 cs=0 l=1 c_cookie=11893446573111748491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa805dc70 tx=0x7f9a9c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50e02a4e169a78b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0540b2070 con 0x7ff0580048d0 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0540a58b0 con 0x7ff0580048d0 2026-02-24T17:25:10.832 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff069ffb640 1 -- 10.20.193.40:0/3771472023 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0540096d0 con 0x7ff0580048d0 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17637fe640 1 -- 10.20.193.40:0/4180093076 <== osd.9 v2:10.20.193.94:6800/3536923368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f177400aa60 con 0x7f175009a110 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17637fe640 10 client.4422.objecter ms_dispatch2 0x7f1784000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17637fe640 10 client.4422.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17637fe640 20 client.4422.objecter put_session s=0x7f1750099a60 osd=9 4 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17637fe640 15 client.4422.objecter _session_command_op_remove 9 2 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761ed76640 1 -- 10.20.193.40:0/3046986858 >> v2:10.20.193.109:3300/0 conn(0x7f7620056c90 msgr2=0x7f7620057060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761ed76640 1 --2- 10.20.193.40:0/3046986858 >> v2:10.20.193.109:3300/0 conn(0x7f7620056c90 0x7f7620057060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761ed76640 1 -- 10.20.193.40:0/3046986858 >> v2:10.20.193.94:3300/0 conn(0x7f76200b4530 msgr2=0x7f76200bc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761ed76640 1 --2- 10.20.193.40:0/3046986858 >> v2:10.20.193.94:3300/0 conn(0x7f76200b4530 0x7f76200bc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761ed76640 1 -- 10.20.193.40:0/3046986858 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76200b5430 con 0x7f76200b4990 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761dd74640 1 --2- 10.20.193.40:0/3046986858 >> v2:10.20.193.94:3300/0 conn(0x7f76200b4530 0x7f76200bc5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fcfec16ada0 0x7fcfec05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfec1673c0 con 0x7fcfec0bc470 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfec1676a0 con 0x7fcfec05d1a0 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcfec167980 con 0x7fcfec16ada0 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfea575640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7fcfec05d1a0 0x7fcfec166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.40:59792/0 (socket says 10.20.193.40:59792) 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfea575640 1 -- 10.20.193.40:0/2076220817 learned_addr learned my addr 10.20.193.40:0/2076220817 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aad319640 1 -- 10.20.193.40:0/1816744889 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a9c0aa450 con 0x7f9aa816ada0 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aad319640 1 -- 10.20.193.40:0/1816744889 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0af070 con 0x7f9aa816ada0 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aad319640 1 -- 10.20.193.40:0/1816744889 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a9c0aa830 con 0x7f9aa816ada0 2026-02-24T17:25:10.833 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1816744889 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa816ada0 msgr2=0x7f9aa8166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 --2- 10.20.193.40:0/1816744889 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa816ada0 0x7f9aa8166bf0 secure :-1 s=READY pgs=115 gs=3 cs=0 l=1 c_cookie=11893446573111748491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa805dc70 tx=0x7f9a9c01c4f0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 10 librados: watch_flush enter 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 10 client.4428.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 15 client.4428.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 20 client.4428.objecter _get_session s=0x7f08640a2380 osd=8 3 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 20 client.4428.objecter put_session s=0x7f08640a2380 osd=8 3 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 20 client.4428.objecter _get_session s=0x7f08640a2380 osd=8 3 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 10 librados: watch_flush exit 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 10 client.4422.objecter close_session for osd.9 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 >> v2:10.20.193.94:6800/3536923368 conn(0x7f175009a110 msgr2=0x7f17500ba540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 --2- 10.20.193.40:0/4180093076 >> v2:10.20.193.94:6800/3536923368 conn(0x7f175009a110 0x7f17500ba540 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 20 client.4422.objecter put_session s=0x7f1750099a60 osd=9 1 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 15 client.4428.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 20 client.4428.objecter get_session s=0x7f08640a2380 osd=8 3 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 15 client.4428.objecter _session_command_op_assign 8 2 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 20 client.4428.objecter put_session s=0x7f08640a2380 osd=8 4 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 10 client.4428.objecter _send_command 2 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 --> v2:10.20.193.40:6808/1991872075 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0854002a20 con 0x7f08640a2a30 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 20 client.4422.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.834 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 10 client.4422.objecter successfully canceled tick 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 >> v2:10.20.193.120:6800/397309233 conn(0x7f17500741e0 msgr2=0x7f1750094690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 --2- 10.20.193.40:0/4180093076 >> v2:10.20.193.120:6800/397309233 conn(0x7f17500741e0 0x7f1750094690 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1778007bf0 tx=0x7f1778006040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1784133420 msgr2=0x7f1784131760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 --2- 10.20.193.40:0/4180093076 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1784133420 0x7f1784131760 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f176c00e580 tx=0x7f176c00ea40 comp rx=0 tx=0).stop 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9d74640 1 --2- 10.20.193.40:0/2076220817 >> v2:10.20.193.94:3300/0 conn(0x7fcfec16ada0 0x7fcfec05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1816744889 shutdown_connections 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 --2- 10.20.193.40:0/1816744889 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa816ada0 0x7f9aa8166bf0 unknown :-1 s=CLOSED pgs=115 gs=3 cs=0 l=1 c_cookie=11893446573111748491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 --2- 10.20.193.40:0/1816744889 >> v2:10.20.193.109:3300/0 conn(0x7f9aa805d1a0 0x7f9aa805d570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1816744889 >> 10.20.193.40:0/1816744889 conn(0x7f9aa80bd200 msgr2=0x7f9aa80bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17837fe640 1 -- 10.20.193.40:0/4180093076 reap_dead start 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 shutdown_connections 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 >> 10.20.193.40:0/4180093076 conn(0x7f17840bd200 msgr2=0x7f17841647c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1816744889 shutdown_connections 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 shutdown_connections 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 -- 10.20.193.40:0/4180093076 wait complete. 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- 10.20.193.40:0/3771472023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff0580048d0 msgr2=0x7ff058004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff0580048d0 0x7ff058004d40 secure :-1 s=READY pgs=114 gs=5 cs=0 l=1 c_cookie=14497414478364828012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff054009ad0 tx=0x7ff05401cac0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.835 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f17895fa640 1 librados: shutdown 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9573640 1 -- 10.20.193.40:0/2076220817 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584326018 0 0) 0x7fcfec1676a0 con 0x7fcfec05d1a0 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9573640 1 -- 10.20.193.40:0/2076220817 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfd8003620 con 0x7fcfec05d1a0 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f0890ff9640 1 -- 10.20.193.40:0/972668373 <== osd.8 v2:10.20.193.40:6808/1991872075 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0854002a20 con 0x7f08640a2a30 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f0890ff9640 10 client.4428.objecter ms_dispatch2 0x7f0894000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f0890ff9640 10 client.4428.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f0890ff9640 20 client.4428.objecter put_session s=0x7f08640a2380 osd=8 4 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f0890ff9640 15 client.4428.objecter _session_command_op_remove 8 2 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9d74640 1 -- 10.20.193.40:0/2076220817 >> v1:10.20.193.109:6789/0 conn(0x7fcfec05d1a0 legacy=0x7fcfec166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- 10.20.193.40:0/3771472023 shutdown_connections 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 --2- 10.20.193.40:0/3771472023 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff0580048d0 0x7ff058004d40 unknown :-1 s=CLOSED pgs=114 gs=5 cs=0 l=1 c_cookie=14497414478364828012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- 10.20.193.40:0/3771472023 >> 10.20.193.40:0/3771472023 conn(0x7ff06c056f10 msgr2=0x7ff06c0b9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9d74640 1 -- 10.20.193.40:0/2076220817 >> v1:10.20.193.94:6789/0 conn(0x7fcfec0bc470 legacy=0x7fcfec0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9d74640 1 -- 10.20.193.40:0/2076220817 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec0b4430 con 0x7fcfec16ada0 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- 10.20.193.40:0/3771472023 shutdown_connections 2026-02-24T17:25:10.836 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- 10.20.193.40:0/3771472023 wait complete. 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 10 librados: watch_flush enter 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 10 librados: watch_flush exit 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 10 client.4428.objecter close_session for osd.8 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 >> v2:10.20.193.40:6808/1991872075 conn(0x7f08640a2a30 msgr2=0x7f08640c2e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 --2- 10.20.193.40:0/972668373 >> v2:10.20.193.40:6808/1991872075 conn(0x7f08640a2a30 0x7f08640c2e60 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 20 client.4428.objecter put_session s=0x7f08640a2380 osd=8 1 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 20 client.4428.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 10 client.4428.objecter successfully canceled tick 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 >> v2:10.20.193.120:6800/397309233 conn(0x7f086407cb00 msgr2=0x7f086409cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 --2- 10.20.193.40:0/972668373 >> v2:10.20.193.120:6800/397309233 conn(0x7f086407cb00 0x7f086409cfb0 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0880002770 tx=0x7f0880009040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1816744889 wait complete. 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 10 client.4425.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 15 client.4425.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 20 client.4425.objecter _get_session s=0x7ff998099970 osd=2 3 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 20 client.4425.objecter put_session s=0x7ff998099970 osd=2 3 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 20 client.4425.objecter _get_session s=0x7ff998099970 osd=2 3 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 15 client.4425.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 librados: starting msgr at 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 librados: starting objecter 2026-02-24T17:25:10.837 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 Processor -- start 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 20 client.4425.objecter get_session s=0x7ff998099970 osd=2 3 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 15 client.4425.objecter _session_command_op_assign 2 2 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 20 client.4425.objecter put_session s=0x7ff998099970 osd=2 4 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 10 client.4425.objecter _send_command 2 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 --> v2:10.20.193.109:6800/1855643564 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9940038c0 con 0x7ff99809a020 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 msgr2=0x7f0894158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 --2- 10.20.193.40:0/972668373 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f089405d570 0x7f0894158e90 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08840047a0 tx=0x7f088400b8e0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f0898e94640 1 -- 10.20.193.40:0/972668373 reap_dead start 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20bce0640 1 Processor -- start 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20bce0640 1 -- start start 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 shutdown_connections 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 >> 10.20.193.40:0/972668373 conn(0x7f08940bd200 msgr2=0x7f08940b8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9b67fc640 1 -- 10.20.193.40:0/866588365 <== osd.2 v2:10.20.193.109:6800/1855643564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9940038c0 con 0x7ff99809a020 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9b67fc640 10 client.4425.objecter ms_dispatch2 0x7ff9c8000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9b67fc640 10 client.4425.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9b67fc640 20 client.4425.objecter put_session s=0x7ff998099970 osd=2 4 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9b67fc640 15 client.4425.objecter _session_command_op_remove 2 2 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7951638640 1 --2- 10.20.193.40:0/4137468480 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c05d1a0 0x7f794c05d570 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=11691600480061393353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f794c05dc70 tx=0x7f794801d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a240e8b11dd889c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7943fff640 1 -- 10.20.193.40:0/4137468480 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79480b3070 con 0x7f794c05d1a0 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7943fff640 1 -- 10.20.193.40:0/4137468480 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79480a6830 con 0x7f794c05d1a0 2026-02-24T17:25:10.838 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7943fff640 1 -- 10.20.193.40:0/4137468480 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79480a6c40 con 0x7f794c05d1a0 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- start start 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 librados: setting wanted keys 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 librados: calling monclient init 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9aa805d1a0 0x7f9aa80bb070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa80bc470 0x7f9aa8139670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9aa816ada0 0x7f9aa8139bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa815d9e0 con 0x7f9aa80bc470 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa815d860 con 0x7f9aa805d1a0 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81cd510 con 0x7f9aa816ada0 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 librados: starting msgr at 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 librados: starting objecter 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20bce0640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fc20415a010 0x7fc2040565f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aae31b640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9aa805d1a0 0x7f9aa80bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f5ce58640 1 --2- 10.20.193.40:0/1745638394 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f5805b560 0x7f8f5805c080 secure :-1 s=READY pgs=65 gs=3 cs=0 l=1 c_cookie=16845246579309678193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f580b7d80 tx=0x7f8f4801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c65683919e0e71 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f4f7fe640 1 -- 10.20.193.40:0/1745638394 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f480b0070 con 0x7f8f5805b560 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f4f7fe640 1 -- 10.20.193.40:0/1745638394 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f480ab620 con 0x7f8f5805b560 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aae31b640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9aa805d1a0 0x7f9aa80bb070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51038/0 (socket says 10.20.193.40:51038) 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aae31b640 1 -- 10.20.193.40:0/1953754049 learned_addr learned my addr 10.20.193.40:0/1953754049 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/1745638394 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f5805b560 msgr2=0x7f8f5805c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.839 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f5f0e3640 1 --2- 10.20.193.40:0/1745638394 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f5805b560 0x7f8f5805c080 secure :-1 s=READY pgs=65 gs=3 cs=0 l=1 c_cookie=16845246579309678193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f580b7d80 tx=0x7f8f4801c540 comp rx=0 tx=0).stop 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aadb1a640 1 --2- 10.20.193.40:0/1953754049 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa80bc470 0x7f9aa8139670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aaeb1c640 1 --2- 10.20.193.40:0/1953754049 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9aa816ada0 0x7f9aa8139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 Processor -- start 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20bce0640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc204164b40 0x7fc204166c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20bce0640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fc204167180 0x7fc2040b42c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761ed76640 1 --2- 10.20.193.40:0/3046986858 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f76200b4990 0x7f76200b7e20 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=12246377644604185916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76200b97a0 tx=0x7f761001d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f3df956beadd3c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9d74640 1 --2- 10.20.193.40:0/2076220817 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec16ada0 0x7fcfec05d570 secure :-1 s=READY pgs=66 gs=3 cs=0 l=1 c_cookie=1423820425872050533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfe0002b70 tx=0x7fcfd401c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13c26d22340c8965 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20bce0640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc204056b30 con 0x7fc204164b40 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20bce0640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc204056e00 con 0x7fc20415a010 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20bce0640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fc2040570e0 con 0x7fc204167180 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209254640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc204164b40 0x7fc204166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc20a256640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fc204167180 0x7fc2040b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209254640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc204164b40 0x7fc204166c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48876/0 (socket says 10.20.193.40:48876) 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209254640 1 -- 10.20.193.40:0/1286699606 learned_addr learned my addr 10.20.193.40:0/1286699606 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/1745638394 shutdown_connections 2026-02-24T17:25:10.840 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f5f0e3640 1 --2- 10.20.193.40:0/1745638394 >> v2:10.20.193.40:3300/0 conn(0x7f8f58159660 0x7f8f58166040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f5f0e3640 1 --2- 10.20.193.40:0/1745638394 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f5805b560 0x7f8f5805c080 unknown :-1 s=CLOSED pgs=65 gs=3 cs=0 l=1 c_cookie=16845246579309678193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/1745638394 >> 10.20.193.40:0/1745638394 conn(0x7f8f580b8fd0 msgr2=0x7f8f580b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f79538c3640 1 -- 10.20.193.40:0/4137468480 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c05d1a0 msgr2=0x7f794c05d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f79538c3640 1 --2- 10.20.193.40:0/4137468480 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c05d1a0 0x7f794c05d570 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=11691600480061393353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f794c05dc70 tx=0x7f794801d7a0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 10 librados: watch_flush enter 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 10 librados: watch_flush exit 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f79538c3640 1 -- 10.20.193.40:0/4137468480 shutdown_connections 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f79538c3640 1 --2- 10.20.193.40:0/4137468480 >> v2:10.20.193.94:3300/0 conn(0x7f794c16ada0 0x7f794c166bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f79538c3640 1 --2- 10.20.193.40:0/4137468480 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c05d1a0 0x7f794c05d570 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=11691600480061393353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f79538c3640 1 -- 10.20.193.40:0/4137468480 >> 10.20.193.40:0/4137468480 conn(0x7f794c0bd200 msgr2=0x7f794c0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 10 client.4425.objecter close_session for osd.2 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 >> v2:10.20.193.109:6800/1855643564 conn(0x7ff99809a020 msgr2=0x7ff9980ba450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 --2- 10.20.193.40:0/866588365 >> v2:10.20.193.109:6800/1855643564 conn(0x7ff99809a020 0x7ff9980ba450 crc :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 20 client.4425.objecter put_session s=0x7ff998099970 osd=2 1 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 20 client.4425.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 10 client.4425.objecter successfully canceled tick 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f79538c3640 1 -- 10.20.193.40:0/4137468480 shutdown_connections 2026-02-24T17:25:10.841 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 shutdown_connections 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aadb1a640 1 -- 10.20.193.40:0/1953754049 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9aa816ada0 msgr2=0x7f9aa8139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aadb1a640 1 --2- 10.20.193.40:0/1953754049 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9aa816ada0 0x7f9aa8139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aadb1a640 1 -- 10.20.193.40:0/1953754049 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9aa805d1a0 msgr2=0x7f9aa80bb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209a55640 1 --2- 10.20.193.40:0/1286699606 >> v2:10.20.193.94:3300/0 conn(0x7fc20415a010 0x7fc2040565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aadb1a640 1 --2- 10.20.193.40:0/1953754049 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9aa805d1a0 0x7f9aa80bb070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aadb1a640 1 -- 10.20.193.40:0/1953754049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa81cb2f0 con 0x7f9aa80bc470 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f79538c3640 1 -- 10.20.193.40:0/4137468480 wait complete. 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 -- 10.20.193.40:0/972668373 wait complete. 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9573640 1 -- 10.20.193.40:0/2076220817 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfd40b2070 con 0x7fcfec16ada0 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9573640 1 -- 10.20.193.40:0/2076220817 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd40ad440 con 0x7fcfec16ada0 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcfe9573640 1 -- 10.20.193.40:0/2076220817 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfe0002e80 con 0x7fcfec16ada0 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 >> v2:10.20.193.120:6800/397309233 conn(0x7ff9980740f0 msgr2=0x7ff9980945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 --2- 10.20.193.40:0/866588365 >> v2:10.20.193.120:6800/397309233 conn(0x7ff9980740f0 0x7ff9980945a0 secure :-1 s=READY pgs=72 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9c8161140 tx=0x7ff9b8008040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9c81648c0 msgr2=0x7ff9c8128f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 --2- 10.20.193.40:0/866588365 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff9c81648c0 0x7ff9c8128f20 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9bc002770 tx=0x7ff9b0005900 comp rx=0 tx=0).stop 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9ce624640 1 -- 10.20.193.40:0/866588365 reap_dead start 2026-02-24T17:25:10.842 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f089a91e640 1 librados: shutdown 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761d573640 1 -- 10.20.193.40:0/3046986858 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76100b3070 con 0x7f76200b4990 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761d573640 1 -- 10.20.193.40:0/3046986858 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76100a68a0 con 0x7f76200b4990 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f761d573640 1 -- 10.20.193.40:0/3046986858 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76100a6cb0 con 0x7f76200b4990 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9aadb1a640 1 --2- 10.20.193.40:0/1953754049 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa80bc470 0x7f9aa8139670 secure :-1 s=READY pgs=118 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a9c01a120 tx=0x7f9a9c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9a8effd640 10 client.?.objecter ms_handle_connect 0x7f9aa80bc470 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9a8effd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec7869640 1 Processor -- start 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 shutdown_connections 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209254640 1 -- 10.20.193.40:0/1286699606 >> v2:10.20.193.109:3300/0 conn(0x7fc204167180 msgr2=0x7fc2040b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209254640 1 --2- 10.20.193.40:0/1286699606 >> v2:10.20.193.109:3300/0 conn(0x7fc204167180 0x7fc2040b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 >> 10.20.193.40:0/866588365 conn(0x7ff9c80bd200 msgr2=0x7ff9c815a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209254640 1 -- 10.20.193.40:0/1286699606 >> v2:10.20.193.94:3300/0 conn(0x7fc20415a010 msgr2=0x7fc2040565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209254640 1 --2- 10.20.193.40:0/1286699606 >> v2:10.20.193.94:3300/0 conn(0x7fc20415a010 0x7fc2040565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fc209254640 1 -- 10.20.193.40:0/1286699606 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2040573c0 con 0x7fc204164b40 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a9c003930 con 0x7f9aa80bc470 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0b7030 con 0x7f9aa80bc470 2026-02-24T17:25:10.843 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a9c003cf0 con 0x7f9aa80bc470 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 shutdown_connections 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 -- 10.20.193.40:0/866588365 wait complete. 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff9d00ae640 1 librados: shutdown 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa8165de0 con 0x7f9aa80bc470 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa8166380 con 0x7f9aa80bc470 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 1 librados: init done 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- start start 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 librados: setting wanted keys 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 librados: calling monclient init 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff0580048d0 0x7ff06c1300d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff06c0572e0 0x7ff06c130610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff06c1342c0 0x7ff06c134740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c15b660 con 0x7ff06c1342c0 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0b8f40 con 0x7ff06c0572e0 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff0719f9640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c15b7e0 con 0x7ff0580048d0 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06b7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff06c1342c0 0x7ff06c134740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06b7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff06c1342c0 0x7ff06c134740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48882/0 (socket says 10.20.193.40:48882) 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 -- 10.20.193.40:0/3046986858 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f76200b4990 msgr2=0x7f76200b7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 --2- 10.20.193.40:0/3046986858 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f76200b4990 0x7f76200b7e20 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=12246377644604185916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76200b97a0 tx=0x7f761001d7d0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06b7fe640 1 -- 10.20.193.40:0/2241170175 learned_addr learned my addr 10.20.193.40:0/2241170175 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06affd640 1 --2- 10.20.193.40:0/2241170175 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff0580048d0 0x7ff06c1300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/2241170175 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff06c0572e0 0x7ff06c130610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 -- 10.20.193.40:0/3046986858 shutdown_connections 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 --2- 10.20.193.40:0/3046986858 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f76200b4990 0x7f76200b7e20 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=12246377644604185916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 --2- 10.20.193.40:0/3046986858 >> v2:10.20.193.94:3300/0 conn(0x7f76200b4530 0x7f76200bc5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 --2- 10.20.193.40:0/3046986858 >> v2:10.20.193.109:3300/0 conn(0x7f7620056c90 0x7f7620057060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 -- 10.20.193.40:0/3046986858 >> 10.20.193.40:0/3046986858 conn(0x7f76200bd300 msgr2=0x7f76200bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 10 client.4412.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 15 client.4412.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 20 client.4412.objecter _get_session s=0x7efbfc099980 osd=12 3 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 20 client.4412.objecter put_session s=0x7efbfc099980 osd=12 3 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 20 client.4412.objecter _get_session s=0x7efbfc099980 osd=12 3 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 15 client.4412.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 -- 10.20.193.40:0/3046986858 shutdown_connections 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 20 client.4412.objecter get_session s=0x7efbfc099980 osd=12 3 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 15 client.4412.objecter _session_command_op_assign 12 2 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 20 client.4412.objecter put_session s=0x7efbfc099980 osd=12 4 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 10 client.4412.objecter _send_command 2 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 --> v2:10.20.193.40:6812/730213184 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efc2c03b110 con 0x7efbfc09a030 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f7624f80640 1 -- 10.20.193.40:0/3046986858 wait complete. 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 -- 10.20.193.40:0/2076220817 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec16ada0 msgr2=0x7fcfec05d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec7869640 1 -- start start 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec7869640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7efec0159f70 0x7efec0058c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec7869640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7efec00b5110 0x7efec00b5520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec7869640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7efec0057eb0 0x7efec0058310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec7869640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7efec0057a20 con 0x7efec0159f70 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec7869640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7efec0058850 con 0x7efec00b5110 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec7869640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7efec0164540 con 0x7efec0057eb0 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 --2- 10.20.193.40:0/2076220817 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec16ada0 0x7fcfec05d570 secure :-1 s=READY pgs=66 gs=3 cs=0 l=1 c_cookie=1423820425872050533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfe0002b70 tx=0x7fcfd401c390 comp rx=0 tx=0).stop 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06affd640 1 -- 10.20.193.40:0/2241170175 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff06c0572e0 msgr2=0x7ff06c130610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06affd640 1 --2- 10.20.193.40:0/2241170175 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff06c0572e0 0x7ff06c130610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06affd640 1 -- 10.20.193.40:0/2241170175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff06c1342c0 msgr2=0x7ff06c134740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06affd640 1 --2- 10.20.193.40:0/2241170175 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff06c1342c0 0x7ff06c134740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06affd640 1 -- 10.20.193.40:0/2241170175 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c134c80 con 0x7ff0580048d0 2026-02-24T17:25:10.846 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/2241170175 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff06c0572e0 0x7ff06c130610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 -- 10.20.193.40:0/2076220817 shutdown_connections 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 --2- 10.20.193.40:0/2076220817 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec16ada0 0x7fcfec05d570 unknown :-1 s=CLOSED pgs=66 gs=3 cs=0 l=1 c_cookie=1423820425872050533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 -- 10.20.193.40:0/2076220817 >> 10.20.193.40:0/2076220817 conn(0x7fcfec0bd200 msgr2=0x7fcfec0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc1a7fc640 1 -- 10.20.193.40:0/745309819 <== osd.12 v2:10.20.193.40:6812/730213184 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efc2800ade0 con 0x7efbfc09a030 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc1a7fc640 10 client.4412.objecter ms_dispatch2 0x7efc2c000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc1a7fc640 10 client.4412.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc1a7fc640 20 client.4412.objecter put_session s=0x7efbfc099980 osd=12 4 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc1a7fc640 15 client.4412.objecter _session_command_op_remove 12 2 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec5ddf640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7efec0057eb0 0x7efec0058310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 -- 10.20.193.40:0/2076220817 shutdown_connections 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec4ddd640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7efec00b5110 0x7efec00b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec4ddd640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7efec00b5110 0x7efec00b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51056/0 (socket says 10.20.193.40:51056) 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efec4ddd640 1 -- 10.20.193.40:0/324971347 learned_addr learned my addr 10.20.193.40:0/324971347 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.847 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7fcff0a3c640 1 -- 10.20.193.40:0/2076220817 wait complete. 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff06affd640 1 --2- 10.20.193.40:0/2241170175 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff0580048d0 0x7ff06c1300d0 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff060007370 tx=0x7ff060007830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff043fff640 10 client.?.objecter ms_handle_connect 0x7ff0580048d0 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff043fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06001a070 con 0x7ff0580048d0 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7efc33e29640 10 librados: watch_flush enter 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 10 librados: watch_flush exit 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06000fbe0 con 0x7ff0580048d0 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c059270 con 0x7ff0580048d0 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.763+0000 7f9ab05a6640 10 client.4461.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 10 client.4412.objecter close_session for osd.12 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9ab05a6640 15 client.4461.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff060012350 con 0x7ff0580048d0 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 10 client.4433.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 >> v2:10.20.193.40:6812/730213184 conn(0x7efbfc09a030 msgr2=0x7efbfc0ba460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.848 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9ab05a6640 20 client.4461.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c057af0 con 0x7ff0580048d0 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 1 librados: init done 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 --2- 10.20.193.40:0/745309819 >> v2:10.20.193.40:6812/730213184 conn(0x7efbfc09a030 0x7efbfc0ba460 crc :-1 s=READY pgs=8 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec55de640 1 --2- 10.20.193.40:0/324971347 >> v2:10.20.193.40:3300/0 conn(0x7efec0159f70 0x7efec0058c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 20 client.4412.objecter put_session s=0x7efbfc099980 osd=12 1 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 20 client.4412.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 10 client.4412.objecter successfully canceled tick 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec55de640 1 -- 10.20.193.40:0/324971347 >> v2:10.20.193.109:3300/0 conn(0x7efec0057eb0 msgr2=0x7efec0058310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec55de640 1 --2- 10.20.193.40:0/324971347 >> v2:10.20.193.109:3300/0 conn(0x7efec0057eb0 0x7efec0058310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 >> v2:10.20.193.120:6800/397309233 conn(0x7efbfc074100 msgr2=0x7efbfc0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 --2- 10.20.193.40:0/745309819 >> v2:10.20.193.120:6800/397309233 conn(0x7efbfc074100 0x7efbfc0945b0 secure :-1 s=READY pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc20002410 tx=0x7efc20003850 comp rx=0 tx=0).stop 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec55de640 1 -- 10.20.193.40:0/324971347 >> v2:10.20.193.94:3300/0 conn(0x7efec00b5110 msgr2=0x7efec00b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec55de640 1 --2- 10.20.193.40:0/324971347 >> v2:10.20.193.94:3300/0 conn(0x7efec00b5110 0x7efec00b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec55de640 1 -- 10.20.193.40:0/324971347 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec00b5b90 con 0x7efec0159f70 2026-02-24T17:25:10.849 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14005a20 msgr2=0x7efc2c13adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc209254640 1 --2- 10.20.193.40:0/1286699606 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc204164b40 0x7fc204166c40 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=2677223365547770062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2040b50e0 tx=0x7fc1f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2527687767d9c0ce server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 --2- 10.20.193.40:0/745309819 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efc14005a20 0x7efc2c13adf0 secure :-1 s=READY pgs=77 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc1c00eb70 tx=0x7efc1c00c4b0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/1745638394 shutdown_connections 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc3239f640 1 -- 10.20.193.40:0/745309819 reap_dead start 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 10 client.4434.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 15 client.4434.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 20 client.4434.objecter _get_session s=0x7fc330099b20 osd=14 3 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 20 client.4434.objecter put_session s=0x7fc330099b20 osd=14 3 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc208a53640 1 -- 10.20.193.40:0/1286699606 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc1f80aa680 con 0x7fc204164b40 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc208a53640 1 -- 10.20.193.40:0/1286699606 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f80af070 con 0x7fc204164b40 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc208a53640 1 -- 10.20.193.40:0/1286699606 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc1f80aaa60 con 0x7fc204164b40 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 10 client.4433.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 15 client.4433.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 20 client.4433.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.850 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 10 client.4433.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 20 client.4434.objecter _get_session s=0x7fc330099b20 osd=14 3 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 15 client.4434.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 20 client.4434.objecter get_session s=0x7fc330099b20 osd=14 3 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 15 client.4434.objecter _session_command_op_assign 14 2 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 20 client.4434.objecter put_session s=0x7fc330099b20 osd=14 4 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 10 client.4434.objecter _send_command 2 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 --> v2:10.20.193.109:6801/1905173416 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3600ba2f0 con 0x7fc33009a1d0 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff06c03b110 con 0x7ff0580048d0 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 librados: starting msgr at 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 librados: starting objecter 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/1745638394 wait complete. 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 Processor -- start 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9ab05a6640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9aa8057810 con 0x7f9aa80bc470 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f9a9c0aa450 con 0x7f9aa80bc470 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 librados: starting msgr at 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 librados: starting objecter 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 shutdown_connections 2026-02-24T17:25:10.851 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 >> 10.20.193.40:0/745309819 conn(0x7efc2c0b8a60 msgr2=0x7efc2c059c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 Processor -- start 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc34e7fc640 1 -- 10.20.193.40:0/2590570348 <== osd.14 v2:10.20.193.109:6801/1905173416 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc3600ba2f0 con 0x7fc33009a1d0 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc34e7fc640 10 client.4434.objecter ms_dispatch2 0x7fc360000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc34e7fc640 10 client.4434.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc34e7fc640 20 client.4434.objecter put_session s=0x7fc330099b20 osd=14 4 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc34e7fc640 15 client.4434.objecter _session_command_op_remove 14 2 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 librados: starting msgr at 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 librados: starting objecter 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 shutdown_connections 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 -- start start 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 librados: setting wanted keys 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 librados: calling monclient init 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 -- 10.20.193.40:0/745309819 wait complete. 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 Processor -- start 2026-02-24T17:25:10.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efc33e29640 1 librados: shutdown 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 -- start start 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 librados: setting wanted keys 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 librados: calling monclient init 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.120:6800/397309233 conn(0x7f9a78074100 0x7f9a780945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 10 librados: watch_flush enter 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 10 librados: watch_flush exit 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 10 client.4434.objecter close_session for osd.14 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 >> v2:10.20.193.109:6801/1905173416 conn(0x7fc33009a1d0 msgr2=0x7fc3300ba600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 --2- 10.20.193.40:0/2590570348 >> v2:10.20.193.109:6801/1905173416 conn(0x7fc33009a1d0 0x7fc3300ba600 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 20 client.4434.objecter put_session s=0x7fc330099b20 osd=14 1 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 20 client.4434.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 10 client.4434.objecter successfully canceled tick 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f9a9c12fc60 con 0x7f9aa80bc470 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 10 client.4461.objecter ms_dispatch2 0x7f9aa8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 3 client.4461.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 3 client.4461.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 >> v2:10.20.193.120:6800/397309233 conn(0x7fc330074240 msgr2=0x7fc3300946f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 --2- 10.20.193.40:0/2590570348 >> v2:10.20.193.120:6800/397309233 conn(0x7fc330074240 0x7fc3300946f0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3601564c0 tx=0x7fc354008040 comp rx=0 tx=0).stop 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc36015b160 msgr2=0x7fc360177f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 --2- 10.20.193.40:0/2590570348 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc36015b160 0x7fc360177f60 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc35000c4d0 tx=0x7fc35000c990 comp rx=0 tx=0).stop 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc3662e3640 1 -- 10.20.193.40:0/2590570348 reap_dead start 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 librados: starting msgr at 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 librados: starting objecter 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7ff06003a8a0 con 0x7ff0580048d0 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f794c05d1a0 0x7f794c139250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 10 client.4461.objecter checking command 1 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 0x7f9a780ba460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 Processor -- start 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 20 client.4461.objecter _get_session s=0x7f9a78099980 osd=0 3 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 20 client.4461.objecter put_session s=0x7f9a78099980 osd=0 3 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 15 client.4461.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 20 client.4461.objecter _get_session s=0x7f9a78099980 osd=0 3 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 20 client.4461.objecter get_session s=0x7f9a78099980 osd=0 3 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 15 client.4461.objecter _session_command_op_assign 0 1 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 20 client.4461.objecter put_session s=0x7f9a78099980 osd=0 4 2026-02-24T17:25:10.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f794c0bc470 0x7f794c133e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9aae31b640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.120:6800/397309233 conn(0x7f9a78074100 0x7f9a780945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 10 client.4461.objecter _send_command 1 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 --> v2:10.20.193.40:6804/1676722186 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a9c0ace70 con 0x7f9a7809a030 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 20 client.4461.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9a9c132330 con 0x7f9aa80bc470 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c16ada0 0x7f794c169600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- start start 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 librados: setting wanted keys 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 librados: calling monclient init 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9aaeb1c640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 0x7f9a780ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9aae31b640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.120:6800/397309233 conn(0x7f9a78074100 0x7f9a780945b0 secure :-1 s=READY pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a98006d20 tx=0x7f9a98009300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 10 client.4461.objecter ms_handle_connect 0x7f9a78074100 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9aaeb1c640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 0x7f9a780ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 10 client.4461.objecter ms_handle_connect 0x7f9a7809a030 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f794c0b49f0 con 0x7f794c16ada0 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f794c0b4710 con 0x7f794c0bc470 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f794c0b5620 con 0x7f794c05d1a0 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c16ada0 0x7f794c169600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951638640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f794c05d1a0 0x7f794c139250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c16ada0 0x7f794c169600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48890/0 (socket says 10.20.193.40:48890) 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951638640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f794c05d1a0 0x7f794c139250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:51046/0 (socket says 10.20.193.40:51046) 2026-02-24T17:25:10.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 -- 10.20.193.40:0/1220016731 learned_addr learned my addr 10.20.193.40:0/1220016731 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7950e37640 1 --2- 10.20.193.40:0/1220016731 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f794c0bc470 0x7f794c133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 -- 10.20.193.40:0/1220016731 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f794c05d1a0 msgr2=0x7f794c139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 --2- 10.20.193.40:0/1220016731 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f794c05d1a0 0x7f794c139250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 -- 10.20.193.40:0/1220016731 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f794c0bc470 msgr2=0x7f794c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 --2- 10.20.193.40:0/1220016731 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f794c0bc470 0x7f794c133e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 -- 10.20.193.40:0/1220016731 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794c137ed0 con 0x7f794c16ada0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7951e39640 1 --2- 10.20.193.40:0/1220016731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c16ada0 0x7f794c169600 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f793c0036c0 tx=0x7f793c016df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7941ffb640 10 client.?.objecter ms_handle_connect 0x7f794c16ada0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7941ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f793c010070 con 0x7f794c16ada0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c00ab10 con 0x7f794c16ada0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f793c014410 con 0x7f794c16ada0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f5805b560 0x7f8f580b2870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f5805c5c0 0x7f8f58141020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f58159660 0x7f8f581315c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8f58162ac0 con 0x7f8f5805c5c0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5805bbf0 con 0x7f8f5805b560 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f8f58166580 con 0x7f8f58159660 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f5805c5c0 0x7f8f58141020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f5805c5c0 0x7f8f58141020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48906/0 (socket says 10.20.193.40:48906) 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 -- 10.20.193.40:0/3341303840 learned_addr learned my addr 10.20.193.40:0/3341303840 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5d659640 1 --2- 10.20.193.40:0/3341303840 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f58159660 0x7f8f581315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6800/397309233 conn(0x7ff03c074090 0x7ff03c094540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7ff060010040 con 0x7ff0580048d0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 10 client.4433.objecter ms_dispatch2 0x7ff06c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 3 client.4433.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 3 client.4433.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6800/397309233 conn(0x7ff03c074090 0x7ff03c094540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 10 client.4433.objecter checking command 1 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 0x7ff03c0ba450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 20 client.4433.objecter _get_session s=0x7ff03c099970 osd=7 3 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 20 client.4433.objecter put_session s=0x7ff03c099970 osd=7 3 2026-02-24T17:25:10.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 15 client.4433.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 20 client.4433.objecter _get_session s=0x7ff03c099970 osd=7 3 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 20 client.4433.objecter get_session s=0x7ff03c099970 osd=7 3 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 15 client.4433.objecter _session_command_op_assign 7 1 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 20 client.4433.objecter put_session s=0x7ff03c099970 osd=7 4 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 10 client.4433.objecter _send_command 1 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 --> v2:10.20.193.120:6813/1724095478 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff060005e50 con 0x7ff03c09a020 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 20 client.4433.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff060095d40 con 0x7ff0580048d0 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfec05d1a0 0x7fcfec1585c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec0bc470 0x7fcfec177e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 -- start start 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 librados: setting wanted keys 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 librados: calling monclient init 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7620056c90 0x7f762015f120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec55de640 1 --2- 10.20.193.40:0/324971347 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec0159f70 0x7efec0058c70 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=10330987110753805604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efec0058bc0 tx=0x7efeb001e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5f0a0a939ea524 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efeaffff640 1 -- 10.20.193.40:0/324971347 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efeb00ae070 con 0x7efec0159f70 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efeaffff640 1 -- 10.20.193.40:0/324971347 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb00a8670 con 0x7efec0159f70 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efeaffff640 1 -- 10.20.193.40:0/324971347 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efeb00a8a60 con 0x7efec0159f70 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 shutdown_connections 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 >> 10.20.193.40:0/2590570348 conn(0x7fc360054690 msgr2=0x7fc360054a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 shutdown_connections 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 -- 10.20.193.40:0/2590570348 wait complete. 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc367d6d640 1 librados: shutdown 2026-02-24T17:25:10.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 -- 10.20.193.40:0/1286699606 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc204164b40 msgr2=0x7fc204166c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 --2- 10.20.193.40:0/1286699606 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc204164b40 0x7fc204166c40 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=2677223365547770062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2040b50e0 tx=0x7fc1f801c500 comp rx=0 tx=0).stop 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 -- 10.20.193.40:0/1286699606 shutdown_connections 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 --2- 10.20.193.40:0/1286699606 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc204164b40 0x7fc204166c40 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=2677223365547770062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 --2- 10.20.193.40:0/1286699606 >> v2:10.20.193.109:3300/0 conn(0x7fc204167180 0x7fc2040b42c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 --2- 10.20.193.40:0/1286699606 >> v2:10.20.193.94:3300/0 conn(0x7fc20415a010 0x7fc2040565f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 -- 10.20.193.40:0/1286699606 >> 10.20.193.40:0/1286699606 conn(0x7fc2040b8fd0 msgr2=0x7fc2040b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 -- 10.20.193.40:0/1220016731 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794c1381b0 con 0x7f794c16ada0 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff06b7fe640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 0x7ff03c0ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfec16ada0 0x7fcfec178360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 -- 10.20.193.40:0/1286699606 shutdown_connections 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 -- 10.20.193.40:0/1286699606 wait complete. 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec0ba9c0 con 0x7fcfec05d1a0 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 10 client.4473.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec1ce520 con 0x7fcfec0bc470 2026-02-24T17:25:10.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcff0a3c640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec15da70 con 0x7fcfec16ada0 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 -- 10.20.193.40:0/1220016731 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f794c138770 con 0x7f794c16ada0 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f79538c3640 1 librados: init done 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfec05d1a0 0x7fcfec1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfe9d74640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec0bc470 0x7fcfec177e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfec05d1a0 0x7fcfec1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48932/0 (socket says 10.20.193.40:48932) 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfe9d74640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec0bc470 0x7fcfec177e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51084/0 (socket says 10.20.193.40:51084) 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 -- 10.20.193.40:0/189156513 learned_addr learned my addr 10.20.193.40:0/189156513 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfead76640 1 --2- 10.20.193.40:0/189156513 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfec16ada0 0x7fcfec178360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 <== osd.0 v2:10.20.193.40:6804/1676722186 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f9a9c0ace70 con 0x7f9a7809a030 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 10 client.4461.objecter ms_dispatch2 0x7f9aa8000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 10 client.4461.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 20 client.4461.objecter put_session s=0x7f9a78099980 osd=0 4 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f9a8effd640 15 client.4461.objecter _session_command_op_remove 0 1 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7620056c90 0x7f762015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7620056c90 0x7f762015f120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48916/0 (socket says 10.20.193.40:48916) 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 -- 10.20.193.40:0/324971347 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec0159f70 msgr2=0x7efec0058c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 --2- 10.20.193.40:0/324971347 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec0159f70 0x7efec0058c70 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=10330987110753805604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efec0058bc0 tx=0x7efeb001e7b0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 -- 10.20.193.40:0/324971347 shutdown_connections 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 --2- 10.20.193.40:0/324971347 >> v2:10.20.193.109:3300/0 conn(0x7efec0057eb0 0x7efec0058310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 --2- 10.20.193.40:0/324971347 >> v2:10.20.193.94:3300/0 conn(0x7efec00b5110 0x7efec00b5520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.859 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 --2- 10.20.193.40:0/324971347 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec0159f70 0x7efec0058c70 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=10330987110753805604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 -- 10.20.193.40:0/324971347 >> 10.20.193.40:0/324971347 conn(0x7efec00b9d40 msgr2=0x7efec00ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 -- 10.20.193.40:0/189156513 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfec16ada0 msgr2=0x7fcfec178360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 --2- 10.20.193.40:0/189156513 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcfec16ada0 0x7fcfec178360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 -- 10.20.193.40:0/324971347 shutdown_connections 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 -- 10.20.193.40:0/189156513 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec0bc470 msgr2=0x7fcfec177e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 --2- 10.20.193.40:0/189156513 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcfec0bc470 0x7fcfec177e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 -- 10.20.193.40:0/189156513 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec17c0a0 con 0x7fcfec05d1a0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5ce58640 1 --2- 10.20.193.40:0/3341303840 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f5805b560 0x7f8f580b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 -- 10.20.193.40:0/3341303840 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f58159660 msgr2=0x7f8f581315c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 --2- 10.20.193.40:0/3341303840 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f58159660 0x7f8f581315c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 -- 10.20.193.40:0/3341303840 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f5805b560 msgr2=0x7f8f580b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 --2- 10.20.193.40:0/3341303840 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f5805b560 0x7f8f580b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 -- 10.20.193.40:0/3341303840 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f581c71c0 con 0x7f8f5805c5c0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4ffff640 1 --2- 10.20.193.40:0/3341303840 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f5805c5c0 0x7f8f58141020 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f4000c700 tx=0x7f8f4000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4d7fa640 10 client.?.objecter ms_handle_connect 0x7f8f5805c5c0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f40017070 con 0x7f8f5805c5c0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f40005bf0 con 0x7f8f5805c5c0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f40007070 con 0x7f8f5805c5c0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f58164b30 con 0x7f8f5805c5c0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 10 client.4476.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f581650f0 con 0x7f8f5805c5c0 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 librados: init done 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff06b7fe640 1 -- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 msgr2=0x7ff03c0ba450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-24T17:25:10.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff06b7fe640 1 -- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 msgr2=0x7ff03c0ba450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff06b7fe640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 0x7ff03c0ba450 crc :-1 s=COMPRESSION_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff06b7fe640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 0x7ff03c0ba450 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff06a7fc640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6800/397309233 conn(0x7ff03c074090 0x7ff03c094540 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff05401c8f0 tx=0x7ff0540af040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7ff043fff640 10 client.4433.objecter ms_handle_connect 0x7ff03c074090 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f791b7fe640 10 client.4473.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f791b7fe640 15 client.4473.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f791b7fe640 20 client.4473.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f791b7fe640 10 client.4473.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7908003900 con 0x7f794c16ada0 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f76200b4530 0x7f762017bd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f76200b4990 0x7f762017a290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f76200bbd90 con 0x7f7620056c90 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 -- 10.20.193.40:0/2639347875 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f76200bcb00 con 0x7f76200b4530 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 -- 10.20.193.40:0/2639347875 learned_addr learned my addr 10.20.193.40:0/2639347875 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 -- 10.20.193.40:0/2639347875 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f762017b870 con 0x7f76200b4990 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761dd74640 1 --2- 10.20.193.40:0/2639347875 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f76200b4530 0x7f762017bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761ed76640 1 --2- 10.20.193.40:0/2639347875 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f76200b4990 0x7f762017a290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 -- 10.20.193.40:0/2639347875 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f76200b4990 msgr2=0x7f762017a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 --2- 10.20.193.40:0/2639347875 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f76200b4990 0x7f762017a290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 -- 10.20.193.40:0/2639347875 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f76200b4530 msgr2=0x7f762017bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 --2- 10.20.193.40:0/2639347875 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f76200b4530 0x7f762017bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 -- 10.20.193.40:0/2639347875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762017a980 con 0x7f7620056c90 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 -- 10.20.193.40:0/324971347 wait complete. 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 10 client.4476.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 15 client.4476.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 20 client.4476.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.861 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 10 client.4476.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f5803b110 con 0x7f8f5805c5c0 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f761e575640 1 --2- 10.20.193.40:0/2639347875 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7620056c90 0x7f762015f120 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7614014c00 tx=0x7f761400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7606ffd640 10 client.?.objecter ms_handle_connect 0x7f7620056c90 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7606ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 librados: starting msgr at 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7614022070 con 0x7f7620056c90 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fc20bce0640 1 librados: starting objecter 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 librados: starting msgr at 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 librados: starting objecter 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761401b740 con 0x7f7620056c90 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f761401bb50 con 0x7f7620056c90 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 Processor -- start 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f793c0145b0 con 0x7f794c16ada0 2026-02-24T17:25:10.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 -- 10.20.193.40:0/2639347875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762017ac60 con 0x7f7620056c90 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 10 client.4482.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 -- 10.20.193.40:0/2639347875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762017b220 con 0x7f7620056c90 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7f7624f80640 1 librados: init done 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 -- start start 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 librados: setting wanted keys 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7efec7869640 1 librados: calling monclient init 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 1 --2- 10.20.193.40:0/1220016731 >> v2:10.20.193.120:6800/397309233 conn(0x7f791c074100 0x7f791c0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f793c0980e0 con 0x7f794c16ada0 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 10 client.4473.objecter ms_dispatch2 0x7f794c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 3 client.4473.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 3 client.4473.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 10 client.4473.objecter checking command 1 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 1 --2- 10.20.193.40:0/1220016731 >> v2:10.20.193.40:6800/2818881548 conn(0x7f791c09a030 0x7f791c0ba460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 20 client.4473.objecter _get_session s=0x7f791c099980 osd=4 3 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 20 client.4473.objecter put_session s=0x7f791c099980 osd=4 3 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 15 client.4473.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 20 client.4473.objecter _get_session s=0x7f791c099980 osd=4 3 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 20 client.4473.objecter get_session s=0x7f791c099980 osd=4 3 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 15 client.4473.objecter _session_command_op_assign 4 1 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 20 client.4473.objecter put_session s=0x7f791c099980 osd=4 4 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 10 client.4473.objecter _send_command 1 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 --> v2:10.20.193.40:6800/2818881548 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f793c018e70 con 0x7f791c09a030 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 20 client.4473.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f793c09f050 con 0x7f794c16ada0 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f8f40007210 con 0x7f8f5805c5c0 2026-02-24T17:25:10.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 Processor -- start 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7604ff9640 10 client.4482.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7604ff9640 15 client.4482.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7604ff9640 20 client.4482.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7604ff9640 10 client.4482.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75dc003900 con 0x7f7620056c90 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 -- start start 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 librados: setting wanted keys 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 librados: calling monclient init 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 1 --2- 10.20.193.40:0/3341303840 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f28074100 0x7f8f280945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc20415a010 0x7fc20411b9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc204164b40 0x7fc204149a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc20415a010 0x7fc20411b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f8f400955a0 con 0x7f8f5805c5c0 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 10 client.4476.objecter ms_dispatch2 0x7f8f58000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 3 client.4476.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 3 client.4476.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc20415a010 0x7fc20411b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48956/0 (socket says 10.20.193.40:48956) 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f761401bcf0 con 0x7f7620056c90 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 -- 10.20.193.40:0/1201311822 learned_addr learned my addr 10.20.193.40:0/1201311822 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 10 client.4476.objecter checking command 1 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 1 --2- 10.20.193.40:0/3341303840 >> v2:10.20.193.94:6804/1872957733 conn(0x7f8f2809a030 0x7f8f280ba460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 20 client.4476.objecter _get_session s=0x7f8f28099980 osd=5 3 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 --2- 10.20.193.40:0/1201311822 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc204167180 0x7fc204149f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc2041c9fe0 con 0x7fc20415a010 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc204167580 con 0x7fc204167180 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 20 client.4476.objecter put_session s=0x7f8f28099980 osd=5 3 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 15 client.4476.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 20 client.4476.objecter _get_session s=0x7f8f28099980 osd=5 3 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 20 client.4476.objecter get_session s=0x7f8f28099980 osd=5 3 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 15 client.4476.objecter _session_command_op_assign 5 1 2026-02-24T17:25:10.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc20415a3e0 con 0x7fc204164b40 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 20 client.4476.objecter put_session s=0x7f8f28099980 osd=5 4 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 10 client.4476.objecter _send_command 1 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 --> v2:10.20.193.94:6804/1872957733 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f280baaf0 con 0x7f8f2809a030 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 20 client.4476.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8f4009c050 con 0x7f8f5805c5c0 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f5ce58640 1 --2- 10.20.193.40:0/3341303840 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f28074100 0x7f8f280945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efec0057eb0 0x7efec0179fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec00b5110 0x7efec0136e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efec0159f70 0x7efec00ac7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efec015a4c0 con 0x7efec00b5110 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7efec015a340 con 0x7efec0057eb0 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7efec00591b0 con 0x7efec0159f70 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec00b5110 0x7efec0136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec00b5110 0x7efec0136e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48944/0 (socket says 10.20.193.40:48944) 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 -- 10.20.193.40:0/3861252323 learned_addr learned my addr 10.20.193.40:0/3861252323 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec55de640 1 --2- 10.20.193.40:0/3861252323 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efec0057eb0 0x7efec0179fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec5ddf640 1 --2- 10.20.193.40:0/3861252323 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efec0159f70 0x7efec00ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 -- 10.20.193.40:0/3861252323 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efec0159f70 msgr2=0x7efec00ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 --2- 10.20.193.40:0/3861252323 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efec0159f70 0x7efec00ac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 -- 10.20.193.40:0/3861252323 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efec0057eb0 msgr2=0x7efec0179fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 --2- 10.20.193.40:0/3861252323 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efec0057eb0 0x7efec0179fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 -- 10.20.193.40:0/3861252323 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec0166310 con 0x7efec00b5110 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec4ddd640 1 --2- 10.20.193.40:0/3861252323 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec00b5110 0x7efec0136e30 secure :-1 s=READY pgs=125 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb4006b50 tx=0x7efeb400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 10 client.?.objecter ms_handle_connect 0x7efec00b5110 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efeb402c070 con 0x7efec00b5110 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb4027410 con 0x7efec00b5110 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec0138c40 con 0x7efec00b5110 2026-02-24T17:25:10.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 10 client.4485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7950e37640 1 --2- 10.20.193.40:0/1220016731 >> v2:10.20.193.40:6800/2818881548 conn(0x7f791c09a030 0x7f791c0ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209254640 1 --2- 10.20.193.40:0/1201311822 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc204164b40 0x7fc204149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20a256640 1 --2- 10.20.193.40:0/1201311822 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc204167180 0x7fc204149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efeb40277e0 con 0x7efec00b5110 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec0136350 con 0x7efec00b5110 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 librados: init done 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 -- 10.20.193.40:0/1201311822 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc204164b40 msgr2=0x7fc204149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 --2- 10.20.193.40:0/1201311822 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc204164b40 0x7fc204149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 -- 10.20.193.40:0/1201311822 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc204167180 msgr2=0x7fc204149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 --2- 10.20.193.40:0/1201311822 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc204167180 0x7fc204149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 -- 10.20.193.40:0/1201311822 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2041657e0 con 0x7fc20415a010 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 1 --2- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6800/397309233 conn(0x7f75ec0740f0 0x7f75ec0945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f5d659640 1 --2- 10.20.193.40:0/3341303840 >> v2:10.20.193.94:6804/1872957733 conn(0x7f8f2809a030 0x7f8f280ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f761401a070 con 0x7f7620056c90 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 10 client.4482.objecter ms_dispatch2 0x7f7620000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 3 client.4482.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 3 client.4482.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 10 client.4473.objecter ms_handle_connect 0x7f791c09a030 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7950e37640 1 --2- 10.20.193.40:0/1220016731 >> v2:10.20.193.40:6800/2818881548 conn(0x7f791c09a030 0x7f791c0ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 10 client.4482.objecter checking command 1 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 1 --2- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6801/50161754 conn(0x7f75ec09a020 0x7f75ec0ba450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 20 client.4482.objecter _get_session s=0x7f75ec099970 osd=11 3 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 20 client.4482.objecter put_session s=0x7f75ec099970 osd=11 3 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 15 client.4482.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 20 client.4482.objecter _get_session s=0x7f75ec099970 osd=11 3 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 20 client.4482.objecter get_session s=0x7f75ec099970 osd=11 3 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 15 client.4482.objecter _session_command_op_assign 11 1 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 20 client.4482.objecter put_session s=0x7f75ec099970 osd=11 4 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 10 client.4482.objecter _send_command 1 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 --> v2:10.20.193.120:6801/50161754 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75ec0baae0 con 0x7f75ec09a020 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 20 client.4482.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f76140a5050 con 0x7f7620056c90 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f761dd74640 1 --2- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6800/397309233 conn(0x7f75ec0740f0 0x7f75ec0945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 10 client.4476.objecter ms_handle_connect 0x7f8f28074100 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f5ce58640 1 --2- 10.20.193.40:0/3341303840 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f28074100 0x7f8f280945b0 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f4801c580 tx=0x7f8f480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 10 client.4485.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 15 client.4485.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 20 client.4485.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 10 client.4485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efec003b110 con 0x7efec00b5110 2026-02-24T17:25:10.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f761ed76640 1 --2- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6801/50161754 conn(0x7f75ec09a020 0x7f75ec0ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.869 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc209a55640 1 --2- 10.20.193.40:0/1201311822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc20415a010 0x7fc20411b9e0 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1f4009500 tx=0x7fc1f400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc1f27fc640 10 client.?.objecter ms_handle_connect 0x7fc20415a010 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc1f27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc1f4017070 con 0x7fc20415a010 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f400cb60 con 0x7fc20415a010 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc1f4013470 con 0x7fc20415a010 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 10 client.4476.objecter ms_handle_connect 0x7f8f2809a030 2026-02-24T17:25:10.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f5d659640 1 --2- 10.20.193.40:0/3341303840 >> v2:10.20.193.94:6804/1872957733 conn(0x7f8f2809a030 0x7f8f280ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 <== osd.4 v2:10.20.193.40:6800/2818881548 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f793c018e70 con 0x7f791c09a030 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 10 client.4473.objecter ms_dispatch2 0x7f794c000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 10 client.4473.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 20 client.4473.objecter put_session s=0x7f791c099980 osd=4 4 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 15 client.4473.objecter _session_command_op_remove 4 1 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7efeb4027980 con 0x7efec00b5110 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f761dd74640 1 --2- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6800/397309233 conn(0x7f75ec0740f0 0x7f75ec0945a0 secure :-1 s=READY pgs=78 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7608009690 tx=0x7f7608009300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 10 client.4482.objecter ms_handle_connect 0x7f75ec0740f0 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2041c7dc0 con 0x7fc20415a010 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 --2- 10.20.193.40:0/3861252323 >> v2:10.20.193.120:6800/397309233 conn(0x7efe90096910 0x7efe900b6dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7efeb409a060 con 0x7efec00b5110 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 10 client.4485.objecter ms_dispatch2 0x7efec0000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 3 client.4485.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 3 client.4485.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 10 client.4488.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20411ac20 con 0x7fc20415a010 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 10 client.4482.objecter ms_handle_connect 0x7f75ec09a020 2026-02-24T17:25:10.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f761ed76640 1 --2- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6801/50161754 conn(0x7f75ec09a020 0x7f75ec0ba450 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 librados: init done 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 10 client.4485.objecter checking command 1 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 --2- 10.20.193.40:0/3861252323 >> v2:10.20.193.94:6812/666336223 conn(0x7efe900bc840 0x7efe900dcc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 20 client.4485.objecter _get_session s=0x7efe900bc190 osd=13 3 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 20 client.4485.objecter put_session s=0x7efe900bc190 osd=13 3 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 15 client.4485.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 20 client.4485.objecter _get_session s=0x7efe900bc190 osd=13 3 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 20 client.4485.objecter get_session s=0x7efe900bc190 osd=13 3 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 15 client.4485.objecter _session_command_op_assign 13 1 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 20 client.4485.objecter put_session s=0x7efe900bc190 osd=13 4 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 10 client.4485.objecter _send_command 1 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 --> v2:10.20.193.94:6812/666336223 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efeb4028e50 con 0x7efe900bc840 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 20 client.4485.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efeb40959b0 con 0x7efec00b5110 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 <== osd.5 v2:10.20.193.94:6804/1872957733 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f8f280baaf0 con 0x7f8f2809a030 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 10 client.4476.objecter ms_dispatch2 0x7f8f58000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 10 client.4476.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 20 client.4476.objecter put_session s=0x7f8f28099980 osd=5 4 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f8f4d7fa640 15 client.4476.objecter _session_command_op_remove 5 1 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec55de640 1 --2- 10.20.193.40:0/3861252323 >> v2:10.20.193.120:6800/397309233 conn(0x7efe90096910 0x7efe900b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7efec5ddf640 1 --2- 10.20.193.40:0/3861252323 >> v2:10.20.193.94:6812/666336223 conn(0x7efe900bc840 0x7efe900dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 10 client.4488.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 15 client.4488.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 20 client.4488.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 10 client.4488.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc20403b110 con 0x7fc20415a010 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 <== osd.11 v2:10.20.193.120:6801/50161754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f75ec0baae0 con 0x7f75ec09a020 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 10 client.4482.objecter ms_dispatch2 0x7f7620000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 10 client.4482.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7951638640 1 --2- 10.20.193.40:0/1220016731 >> v2:10.20.193.120:6800/397309233 conn(0x7f791c074100 0x7f791c0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7941ffb640 10 client.4473.objecter ms_handle_connect 0x7f791c074100 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7951638640 1 --2- 10.20.193.40:0/1220016731 >> v2:10.20.193.120:6800/397309233 conn(0x7f791c074100 0x7f791c0945b0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7948003920 tx=0x7f79480a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 20 client.4482.objecter put_session s=0x7f75ec099970 osd=11 4 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7f7606ffd640 15 client.4482.objecter _session_command_op_remove 11 1 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfea575640 1 --2- 10.20.193.40:0/189156513 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfec05d1a0 0x7fcfec1585c0 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfe0003020 tx=0x7fcfe000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfd2ffd640 10 client.?.objecter ms_handle_connect 0x7fcfec05d1a0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfd2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfe0018070 con 0x7fcfec05d1a0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe000ce50 con 0x7fcfec05d1a0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.767+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfe00070d0 con 0x7fcfec05d1a0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efec55de640 1 --2- 10.20.193.40:0/3861252323 >> v2:10.20.193.120:6800/397309233 conn(0x7efe90096910 0x7efe900b6dc0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb001e7f0 tx=0x7efeb00a9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efeadffb640 10 client.4485.objecter ms_handle_connect 0x7efe90096910 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.771+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fc1f4024060 con 0x7fc20415a010 2026-02-24T17:25:10.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efeadffb640 10 client.4485.objecter ms_handle_connect 0x7efe900bc840 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efec5ddf640 1 --2- 10.20.193.40:0/3861252323 >> v2:10.20.193.94:6812/666336223 conn(0x7efe900bc840 0x7efe900dcc70 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.873 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 1 --2- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6800/397309233 conn(0x7fc1d4074100 0x7fc1d40945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc209254640 1 --2- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6800/397309233 conn(0x7fc1d4074100 0x7fc1d40945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fc1f400f040 con 0x7fc20415a010 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 10 client.4488.objecter ms_dispatch2 0x7fc204000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 3 client.4488.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 3 client.4488.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 <== osd.13 v2:10.20.193.94:6812/666336223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7efeb4028e50 con 0x7efe900bc840 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efeadffb640 10 client.4485.objecter ms_dispatch2 0x7efec0000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efeadffb640 10 client.4485.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efeadffb640 20 client.4485.objecter put_session s=0x7efe900bc190 osd=13 4 2026-02-24T17:25:10.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7efeadffb640 15 client.4485.objecter _session_command_op_remove 13 1 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 10 client.4488.objecter checking command 1 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 1 --2- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6805/2868608910 conn(0x7fc1d409a030 0x7fc1d40ba460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 20 client.4488.objecter _get_session s=0x7fc1d4099980 osd=15 3 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 20 client.4488.objecter put_session s=0x7fc1d4099980 osd=15 3 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 15 client.4488.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 20 client.4488.objecter _get_session s=0x7fc1d4099980 osd=15 3 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 20 client.4488.objecter get_session s=0x7fc1d4099980 osd=15 3 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 15 client.4488.objecter _session_command_op_assign 15 1 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 20 client.4488.objecter put_session s=0x7fc1d4099980 osd=15 4 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 10 client.4488.objecter _send_command 1 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 --> v2:10.20.193.120:6805/2868608910 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1f4014e50 con 0x7fc1d409a030 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 20 client.4488.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1f40985a0 con 0x7fc20415a010 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc20a256640 1 --2- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6805/2868608910 conn(0x7fc1d409a030 0x7fc1d40ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc209254640 1 --2- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6800/397309233 conn(0x7fc1d4074100 0x7fc1d40945b0 secure :-1 s=READY pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1f801a130 tx=0x7fc1f80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 10 client.4488.objecter ms_handle_connect 0x7fc1d4074100 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfec17c380 con 0x7fcfec05d1a0 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc20a256640 1 --2- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6805/2868608910 conn(0x7fc1d409a030 0x7fc1d40ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 10 client.4488.objecter ms_handle_connect 0x7fc1d409a030 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 10 client.4479.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfec177620 con 0x7fcfec05d1a0 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 1 librados: init done 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 10 client.4479.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 15 client.4479.objecter _session_command_op_assign -1 1 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 20 client.4479.objecter _get_session osd=-1 returning homeless 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 10 client.4479.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcfec057810 con 0x7fcfec05d1a0 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 <== osd.15 v2:10.20.193.120:6805/2868608910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fc1f4014e50 con 0x7fc1d409a030 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 10 client.4488.objecter ms_dispatch2 0x7fc204000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 10 client.4488.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 20 client.4488.objecter put_session s=0x7fc1d4099980 osd=15 4 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fc1f27fc640 15 client.4488.objecter _session_command_op_remove 15 1 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fcfe0007270 con 0x7fcfec05d1a0 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcfd2ffd640 1 --2- 10.20.193.40:0/189156513 >> v2:10.20.193.120:6800/397309233 conn(0x7fcfb80741d0 0x7fcfb8094680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fcfe00956f0 con 0x7fcfec05d1a0 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcfd2ffd640 10 client.4479.objecter ms_dispatch2 0x7fcfec000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcfe9d74640 1 --2- 10.20.193.40:0/189156513 >> v2:10.20.193.120:6800/397309233 conn(0x7fcfb80741d0 0x7fcfb8094680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcfd2ffd640 3 client.4479.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.775+0000 7fcfd2ffd640 3 client.4479.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 10 client.4479.objecter checking command 1 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 1 --2- 10.20.193.40:0/189156513 >> v2:10.20.193.109:6808/194638238 conn(0x7fcfb809a100 0x7fcfb80ba530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 20 client.4479.objecter _get_session s=0x7fcfb8099a50 osd=10 3 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 20 client.4479.objecter put_session s=0x7fcfb8099a50 osd=10 3 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 15 client.4479.objecter _session_command_op_remove -1 1 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 20 client.4479.objecter _get_session s=0x7fcfb8099a50 osd=10 3 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 20 client.4479.objecter get_session s=0x7fcfb8099a50 osd=10 3 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 15 client.4479.objecter _session_command_op_assign 10 1 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 20 client.4479.objecter put_session s=0x7fcfb8099a50 osd=10 4 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 10 client.4479.objecter _send_command 1 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 --> v2:10.20.193.109:6808/194638238 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfe0016e50 con 0x7fcfb809a100 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 20 client.4479.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcfe009c050 con 0x7fcfec05d1a0 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfe9d74640 1 --2- 10.20.193.40:0/189156513 >> v2:10.20.193.120:6800/397309233 conn(0x7fcfb80741d0 0x7fcfb8094680 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd401c3d0 tx=0x7fcfd40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 10 client.4479.objecter ms_handle_connect 0x7fcfb80741d0 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfead76640 1 --2- 10.20.193.40:0/189156513 >> v2:10.20.193.109:6808/194638238 conn(0x7fcfb809a100 0x7fcfb80ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.876 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfead76640 1 --2- 10.20.193.40:0/189156513 >> v2:10.20.193.109:6808/194638238 conn(0x7fcfb809a100 0x7fcfb80ba530 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 10 client.4479.objecter ms_handle_connect 0x7fcfb809a100 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 10 client.4461.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 15 client.4461.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 20 client.4461.objecter _get_session s=0x7f9a78099980 osd=0 3 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 20 client.4461.objecter put_session s=0x7f9a78099980 osd=0 3 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 20 client.4461.objecter _get_session s=0x7f9a78099980 osd=0 3 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 15 client.4461.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 20 client.4461.objecter get_session s=0x7f9a78099980 osd=0 3 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 15 client.4461.objecter _session_command_op_assign 0 2 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 20 client.4461.objecter put_session s=0x7f9a78099980 osd=0 4 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 10 client.4461.objecter _send_command 2 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 --> v2:10.20.193.40:6804/1676722186 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9aa803b110 con 0x7f9a7809a030 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9aaeb1c640 1 -- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 msgr2=0x7f9a780ba460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9aaeb1c640 1 -- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 msgr2=0x7f9a780ba460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9aaeb1c640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 0x7f9a780ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9aaeb1c640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 0x7f9a780ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 1 client.4461.objecter ms_handle_reset 0x7f9a7809a030 session 0x7f9a78099980 osd.0 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 10 client.4461.objecter reopen_session osd.0 session, addr now v2:10.20.193.40:6804/1676722186 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 msgr2=0x7f9a780ba460 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a7809a030 0x7f9a780ba460 unknown :-1 s=CLOSED pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a780bac90 0x7f9a780db070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 10 client.4461.objecter _send_command 2 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 --> v2:10.20.193.40:6804/1676722186 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a9c0ace70 con 0x7f9a780bac90 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=30}) -- 0x7f9a780db680 con 0x7f9aa80bc470 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9aaeb1c640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a780bac90 0x7f9a780db070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 10 client.4461.objecter ms_handle_connect 0x7f9a780bac90 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9aaeb1c640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a780bac90 0x7f9a780db070 crc :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 <== osd.10 v2:10.20.193.109:6808/194638238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fcfe0016e50 con 0x7fcfb809a100 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 10 client.4479.objecter ms_dispatch2 0x7fcfec000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 10 client.4479.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 20 client.4479.objecter put_session s=0x7fcfb8099a50 osd=10 4 2026-02-24T17:25:10.877 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7fcfd2ffd640 15 client.4479.objecter _session_command_op_remove 10 1 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 1 -- 10.20.193.40:0/1953754049 <== osd.0 v2:10.20.193.40:6804/1676722186 1 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a9c0ace70 con 0x7f9a780bac90 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 10 client.4461.objecter ms_dispatch2 0x7f9aa8000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 10 client.4461.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 20 client.4461.objecter put_session s=0x7f9a78099980 osd=0 4 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9a8effd640 15 client.4461.objecter _session_command_op_remove 0 2 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 10 librados: watch_flush enter 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 10 librados: watch_flush exit 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 10 client.4461.objecter close_session for osd.0 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a780bac90 msgr2=0x7f9a780db070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.40:6804/1676722186 conn(0x7f9a780bac90 0x7f9a780db070 crc :-1 s=READY pgs=9 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 20 client.4461.objecter put_session s=0x7f9a78099980 osd=0 1 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 20 client.4461.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 10 client.4461.objecter successfully canceled tick 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 >> v2:10.20.193.120:6800/397309233 conn(0x7f9a78074100 msgr2=0x7f9a780945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 --2- 10.20.193.40:0/1953754049 >> v2:10.20.193.120:6800/397309233 conn(0x7f9a78074100 0x7f9a780945b0 secure :-1 s=READY pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a98006d20 tx=0x7f9a98009300 comp rx=0 tx=0).stop 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa80bc470 msgr2=0x7f9aa8139670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 --2- 10.20.193.40:0/1953754049 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9aa80bc470 0x7f9aa8139670 secure :-1 s=READY pgs=118 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a9c01a120 tx=0x7f9a9c019290 comp rx=0 tx=0).stop 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9aaeb1c640 1 -- 10.20.193.40:0/1953754049 reap_dead start 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 shutdown_connections 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 >> 10.20.193.40:0/1953754049 conn(0x7f9aa80bd200 msgr2=0x7f9aa815c410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 shutdown_connections 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 -- 10.20.193.40:0/1953754049 wait complete. 2026-02-24T17:25:10.878 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f9ab05a6640 1 librados: shutdown 2026-02-24T17:25:10.879 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.879 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T17:25:10.879 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.879 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-24T17:25:10.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 10 client.4473.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 15 client.4473.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 20 client.4473.objecter _get_session s=0x7f791c099980 osd=4 3 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 20 client.4473.objecter put_session s=0x7f791c099980 osd=4 3 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 20 client.4473.objecter _get_session s=0x7f791c099980 osd=4 3 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 15 client.4473.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 20 client.4473.objecter get_session s=0x7f791c099980 osd=4 3 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 15 client.4473.objecter _session_command_op_assign 4 2 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 20 client.4473.objecter put_session s=0x7f791c099980 osd=4 4 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 10 client.4473.objecter _send_command 2 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 --> v2:10.20.193.40:6800/2818881548 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7908002a20 con 0x7f791c09a030 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f7941ffb640 1 -- 10.20.193.40:0/1220016731 <== osd.4 v2:10.20.193.40:6800/2818881548 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7908002a20 con 0x7f791c09a030 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f7941ffb640 10 client.4473.objecter ms_dispatch2 0x7f794c000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f7941ffb640 10 client.4473.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f7941ffb640 20 client.4473.objecter put_session s=0x7f791c099980 osd=4 4 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.779+0000 7f7941ffb640 15 client.4473.objecter _session_command_op_remove 4 2 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 10 librados: watch_flush enter 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 10 librados: watch_flush exit 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 10 client.4473.objecter close_session for osd.4 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 >> v2:10.20.193.40:6800/2818881548 conn(0x7f791c09a030 msgr2=0x7f791c0ba460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 --2- 10.20.193.40:0/1220016731 >> v2:10.20.193.40:6800/2818881548 conn(0x7f791c09a030 0x7f791c0ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 20 client.4473.objecter put_session s=0x7f791c099980 osd=4 1 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 20 client.4473.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 10 client.4473.objecter successfully canceled tick 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 >> v2:10.20.193.120:6800/397309233 conn(0x7f791c074100 msgr2=0x7f791c0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 --2- 10.20.193.40:0/1220016731 >> v2:10.20.193.120:6800/397309233 conn(0x7f791c074100 0x7f791c0945b0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7948003920 tx=0x7f79480a8070 comp rx=0 tx=0).stop 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c16ada0 msgr2=0x7f794c169600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 --2- 10.20.193.40:0/1220016731 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f794c16ada0 0x7f794c169600 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f793c0036c0 tx=0x7f793c016df0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7951e39640 1 -- 10.20.193.40:0/1220016731 reap_dead start 2026-02-24T17:25:10.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 shutdown_connections 2026-02-24T17:25:10.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 >> 10.20.193.40:0/1220016731 conn(0x7f794c0bd200 msgr2=0x7f794c159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 shutdown_connections 2026-02-24T17:25:10.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 -- 10.20.193.40:0/1220016731 wait complete. 2026-02-24T17:25:10.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f791b7fe640 1 librados: shutdown 2026-02-24T17:25:10.881 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.881 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-24T17:25:10.881 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:10.881 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 10 client.4482.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 15 client.4482.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 20 client.4482.objecter _get_session s=0x7f75ec099970 osd=11 3 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 20 client.4482.objecter put_session s=0x7f75ec099970 osd=11 3 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 20 client.4482.objecter _get_session s=0x7f75ec099970 osd=11 3 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 15 client.4482.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 20 client.4482.objecter get_session s=0x7f75ec099970 osd=11 3 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 15 client.4482.objecter _session_command_op_assign 11 2 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 20 client.4482.objecter put_session s=0x7f75ec099970 osd=11 4 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 10 client.4482.objecter _send_command 2 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 --> v2:10.20.193.120:6801/50161754 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f75dc002a20 con 0x7f75ec09a020 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.882 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7606ffd640 1 -- 10.20.193.40:0/2639347875 <== osd.11 v2:10.20.193.120:6801/50161754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f75dc002a20 con 0x7f75ec09a020 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7606ffd640 10 client.4482.objecter ms_dispatch2 0x7f7620000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7606ffd640 10 client.4482.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7606ffd640 20 client.4482.objecter put_session s=0x7f75ec099970 osd=11 4 2026-02-24T17:25:10.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7606ffd640 15 client.4482.objecter _session_command_op_remove 11 2 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 10 client.4485.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 15 client.4485.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 20 client.4485.objecter _get_session s=0x7efe900bc190 osd=13 3 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 20 client.4485.objecter put_session s=0x7efe900bc190 osd=13 3 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 20 client.4485.objecter _get_session s=0x7efe900bc190 osd=13 3 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 15 client.4485.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 20 client.4485.objecter get_session s=0x7efe900bc190 osd=13 3 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 15 client.4485.objecter _session_command_op_assign 13 2 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 20 client.4485.objecter put_session s=0x7efe900bc190 osd=13 4 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 10 client.4485.objecter _send_command 2 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 --> v2:10.20.193.94:6812/666336223 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efec0058310 con 0x7efe900bc840 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 10 librados: watch_flush enter 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 10 librados: watch_flush exit 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 10 client.4482.objecter close_session for osd.11 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6801/50161754 conn(0x7f75ec09a020 msgr2=0x7f75ec0ba450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 --2- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6801/50161754 conn(0x7f75ec09a020 0x7f75ec0ba450 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 10 client.4476.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 15 client.4476.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 20 client.4476.objecter _get_session s=0x7f8f28099980 osd=5 3 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 20 client.4476.objecter put_session s=0x7f8f28099980 osd=5 3 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 20 client.4482.objecter put_session s=0x7f75ec099970 osd=11 1 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 20 client.4482.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 10 client.4482.objecter successfully canceled tick 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 20 client.4476.objecter _get_session s=0x7f8f28099980 osd=5 3 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 15 client.4476.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 20 client.4476.objecter get_session s=0x7f8f28099980 osd=5 3 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 15 client.4476.objecter _session_command_op_assign 5 2 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 20 client.4476.objecter put_session s=0x7f8f28099980 osd=5 4 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 10 client.4476.objecter _send_command 2 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 --> v2:10.20.193.94:6804/1872957733 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8f5805c060 con 0x7f8f2809a030 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6800/397309233 conn(0x7f75ec0740f0 msgr2=0x7f75ec0945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 --2- 10.20.193.40:0/2639347875 >> v2:10.20.193.120:6800/397309233 conn(0x7f75ec0740f0 0x7f75ec0945a0 secure :-1 s=READY pgs=78 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7608009690 tx=0x7f7608009300 comp rx=0 tx=0).stop 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7620056c90 msgr2=0x7f762015f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 --2- 10.20.193.40:0/2639347875 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7620056c90 0x7f762015f120 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7614014c00 tx=0x7f761400b790 comp rx=0 tx=0).stop 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efeadffb640 1 -- 10.20.193.40:0/3861252323 <== osd.13 v2:10.20.193.94:6812/666336223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efec0058310 con 0x7efe900bc840 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efeadffb640 10 client.4485.objecter ms_dispatch2 0x7efec0000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f761ed76640 1 -- 10.20.193.40:0/2639347875 reap_dead start 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efeadffb640 10 client.4485.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efeadffb640 20 client.4485.objecter put_session s=0x7efe900bc190 osd=13 4 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efeadffb640 15 client.4485.objecter _session_command_op_remove 13 2 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 shutdown_connections 2026-02-24T17:25:10.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 >> 10.20.193.40:0/2639347875 conn(0x7f76200bd300 msgr2=0x7f76200bd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 shutdown_connections 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 -- 10.20.193.40:0/2639347875 wait complete. 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f7604ff9640 1 librados: shutdown 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f4d7fa640 1 -- 10.20.193.40:0/3341303840 <== osd.5 v2:10.20.193.94:6804/1872957733 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8f5805c060 con 0x7f8f2809a030 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f4d7fa640 10 client.4476.objecter ms_dispatch2 0x7f8f58000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 10 librados: watch_flush enter 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f4d7fa640 10 client.4476.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f4d7fa640 20 client.4476.objecter put_session s=0x7f8f28099980 osd=5 4 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f4d7fa640 15 client.4476.objecter _session_command_op_remove 5 2 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 10 librados: watch_flush exit 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 10 client.4485.objecter close_session for osd.13 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 >> v2:10.20.193.94:6812/666336223 conn(0x7efe900bc840 msgr2=0x7efe900dcc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 --2- 10.20.193.40:0/3861252323 >> v2:10.20.193.94:6812/666336223 conn(0x7efe900bc840 0x7efe900dcc70 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 20 client.4485.objecter put_session s=0x7efe900bc190 osd=13 1 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 20 client.4485.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 10 client.4485.objecter successfully canceled tick 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 >> v2:10.20.193.120:6800/397309233 conn(0x7efe90096910 msgr2=0x7efe900b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 --2- 10.20.193.40:0/3861252323 >> v2:10.20.193.120:6800/397309233 conn(0x7efe90096910 0x7efe900b6dc0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb001e7f0 tx=0x7efeb00a9000 comp rx=0 tx=0).stop 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec00b5110 msgr2=0x7efec0136e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 --2- 10.20.193.40:0/3861252323 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efec00b5110 0x7efec0136e30 secure :-1 s=READY pgs=125 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb4006b50 tx=0x7efeb400c520 comp rx=0 tx=0).stop 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec5ddf640 1 -- 10.20.193.40:0/3861252323 reap_dead start 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 shutdown_connections 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 >> 10.20.193.40:0/3861252323 conn(0x7efec00b9d40 msgr2=0x7efec00ba110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 shutdown_connections 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 -- 10.20.193.40:0/3861252323 wait complete. 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 10 librados: watch_flush enter 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7efec7869640 1 librados: shutdown 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 10 librados: watch_flush exit 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 10 client.4476.objecter close_session for osd.5 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 >> v2:10.20.193.94:6804/1872957733 conn(0x7f8f2809a030 msgr2=0x7f8f280ba460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 --2- 10.20.193.40:0/3341303840 >> v2:10.20.193.94:6804/1872957733 conn(0x7f8f2809a030 0x7f8f280ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 20 client.4476.objecter put_session s=0x7f8f28099980 osd=5 1 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 20 client.4476.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.886 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 10 client.4476.objecter successfully canceled tick 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f28074100 msgr2=0x7f8f280945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 --2- 10.20.193.40:0/3341303840 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f28074100 0x7f8f280945b0 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f4801c580 tx=0x7f8f480a6000 comp rx=0 tx=0).stop 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f5805c5c0 msgr2=0x7f8f58141020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 --2- 10.20.193.40:0/3341303840 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f5805c5c0 0x7f8f58141020 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f4000c700 tx=0x7f8f4000cbc0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5d659640 1 -- 10.20.193.40:0/3341303840 reap_dead start 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 shutdown_connections 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 >> 10.20.193.40:0/3341303840 conn(0x7f8f580b8fd0 msgr2=0x7f8f580b93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 shutdown_connections 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 -- 10.20.193.40:0/3341303840 wait complete. 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.783+0000 7f8f5f0e3640 1 librados: shutdown 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 10 client.4488.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 15 client.4488.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 20 client.4488.objecter _get_session s=0x7fc1d4099980 osd=15 3 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 20 client.4488.objecter put_session s=0x7fc1d4099980 osd=15 3 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 20 client.4488.objecter _get_session s=0x7fc1d4099980 osd=15 3 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 15 client.4488.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 20 client.4488.objecter get_session s=0x7fc1d4099980 osd=15 3 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 15 client.4488.objecter _session_command_op_assign 15 2 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 20 client.4488.objecter put_session s=0x7fc1d4099980 osd=15 4 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 10 client.4488.objecter _send_command 2 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 --> v2:10.20.193.120:6805/2868608910 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc204058160 con 0x7fc1d409a030 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc1f27fc640 1 -- 10.20.193.40:0/1201311822 <== osd.15 v2:10.20.193.120:6805/2868608910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc204058160 con 0x7fc1d409a030 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc1f27fc640 10 client.4488.objecter ms_dispatch2 0x7fc204000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc1f27fc640 10 client.4488.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc1f27fc640 20 client.4488.objecter put_session s=0x7fc1d4099980 osd=15 4 2026-02-24T17:25:10.887 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc1f27fc640 15 client.4488.objecter _session_command_op_remove 15 2 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 10 librados: watch_flush enter 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 10 librados: watch_flush exit 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 10 client.4488.objecter close_session for osd.15 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6805/2868608910 conn(0x7fc1d409a030 msgr2=0x7fc1d40ba460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 --2- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6805/2868608910 conn(0x7fc1d409a030 0x7fc1d40ba460 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 20 client.4488.objecter put_session s=0x7fc1d4099980 osd=15 1 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 20 client.4488.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 10 client.4488.objecter successfully canceled tick 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6800/397309233 conn(0x7fc1d4074100 msgr2=0x7fc1d40945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 --2- 10.20.193.40:0/1201311822 >> v2:10.20.193.120:6800/397309233 conn(0x7fc1d4074100 0x7fc1d40945b0 secure :-1 s=READY pgs=81 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1f801a130 tx=0x7fc1f80a7000 comp rx=0 tx=0).stop 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc20415a010 msgr2=0x7fc20411b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 --2- 10.20.193.40:0/1201311822 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc20415a010 0x7fc20411b9e0 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1f4009500 tx=0x7fc1f400ed40 comp rx=0 tx=0).stop 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20a256640 1 -- 10.20.193.40:0/1201311822 reap_dead start 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 shutdown_connections 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 >> 10.20.193.40:0/1201311822 conn(0x7fc2040b8fd0 msgr2=0x7fc20405dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 shutdown_connections 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 -- 10.20.193.40:0/1201311822 wait complete. 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.787+0000 7fc20bce0640 1 librados: shutdown 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 10 client.4479.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 15 client.4479.objecter _session_command_op_assign -1 2 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 20 client.4479.objecter _get_session s=0x7fcfb8099a50 osd=10 3 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 20 client.4479.objecter put_session s=0x7fcfb8099a50 osd=10 3 2026-02-24T17:25:10.888 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 20 client.4479.objecter _get_session s=0x7fcfb8099a50 osd=10 3 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 15 client.4479.objecter _session_command_op_remove -1 2 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 20 client.4479.objecter get_session s=0x7fcfb8099a50 osd=10 3 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 15 client.4479.objecter _session_command_op_assign 10 2 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 20 client.4479.objecter put_session s=0x7fcfb8099a50 osd=10 4 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 10 client.4479.objecter _send_command 2 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 --> v2:10.20.193.109:6808/194638238 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcfec03b110 con 0x7fcfb809a100 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcfd2ffd640 1 -- 10.20.193.40:0/189156513 <== osd.10 v2:10.20.193.109:6808/194638238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcfdc006040 con 0x7fcfb809a100 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcfd2ffd640 10 client.4479.objecter ms_dispatch2 0x7fcfec000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcfd2ffd640 10 client.4479.objecter _finish_command 2 = system:0 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcfd2ffd640 20 client.4479.objecter put_session s=0x7fcfb8099a50 osd=10 4 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcfd2ffd640 15 client.4479.objecter _session_command_op_remove 10 2 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 10 librados: watch_flush enter 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 10 librados: watch_flush exit 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 10 client.4479.objecter close_session for osd.10 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 >> v2:10.20.193.109:6808/194638238 conn(0x7fcfb809a100 msgr2=0x7fcfb80ba530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 --2- 10.20.193.40:0/189156513 >> v2:10.20.193.109:6808/194638238 conn(0x7fcfb809a100 0x7fcfb80ba530 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 20 client.4479.objecter put_session s=0x7fcfb8099a50 osd=10 1 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 20 client.4479.objecter shutdown clearing up homeless session... 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 10 client.4479.objecter successfully canceled tick 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 >> v2:10.20.193.120:6800/397309233 conn(0x7fcfb80741d0 msgr2=0x7fcfb8094680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 --2- 10.20.193.40:0/189156513 >> v2:10.20.193.120:6800/397309233 conn(0x7fcfb80741d0 0x7fcfb8094680 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd401c3d0 tx=0x7fcfd40a7070 comp rx=0 tx=0).stop 2026-02-24T17:25:10.889 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfec05d1a0 msgr2=0x7fcfec1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 --2- 10.20.193.40:0/189156513 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcfec05d1a0 0x7fcfec1585c0 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfe0003020 tx=0x7fcfe000cc00 comp rx=0 tx=0).stop 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcfead76640 1 -- 10.20.193.40:0/189156513 reap_dead start 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 shutdown_connections 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 >> 10.20.193.40:0/189156513 conn(0x7fcfec0bd200 msgr2=0x7fcfec0b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 shutdown_connections 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 -- 10.20.193.40:0/189156513 wait complete. 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.791+0000 7fcff0a3c640 1 librados: shutdown 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.890 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-24T17:25:10.890 INFO:teuthology.orchestra.run.trial040.stdout:90194313221 2026-02-24T17:25:10.891 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T17:25:10.891 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:10.891 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-24T17:25:10.891 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.891 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T17:25:10.892 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.892 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-24T17:25:10.892 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:10.892 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-24T17:25:10.893 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:10.893 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T17:25:10.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff31205e640 1 Processor -- start 2026-02-24T17:25:10.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff31205e640 1 -- start start 2026-02-24T17:25:10.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc71151640 1 Processor -- start 2026-02-24T17:25:10.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc71151640 1 -- start start 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff31205e640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7ff30c0566e0 0x7ff30c056ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff31205e640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7ff30c0b4860 0x7ff30c0b4ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff31205e640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c1668d0 con 0x7ff30c15cba0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff31205e640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c0b43d0 con 0x7ff30c0b4860 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff31205e640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c0b51e0 con 0x7ff30c0566e0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30bfff640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7ff30c15cba0 0x7ff30c15d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45722/0 (socket says 10.20.193.40:45722) 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30b7fe640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7ff30c0566e0 0x7ff30c056ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30bfff640 1 -- 10.20.193.40:0/2627226743 learned_addr learned my addr 10.20.193.40:0/2627226743 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30affd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7ff30c0b4860 0x7ff30c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc71151640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fdc6c16ada0 0x7fdc6c05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc71151640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fdc6c0bc470 0x7fdc6c0b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc71151640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc6c1673c0 con 0x7fdc6c05d1a0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc71151640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdc6c1676a0 con 0x7fdc6c0bc470 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc71151640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fdc6c167980 con 0x7fdc6c16ada0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc6b577640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fdc6c0bc470 0x7fdc6c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc6b577640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fdc6c0bc470 0x7fdc6c0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48966/0 (socket says 10.20.193.40:48966) 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30a7fc640 1 -- 10.20.193.40:0/2627226743 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551210291 0 0) 0x7ff30c1668d0 con 0x7ff30c15cba0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30a7fc640 1 -- 10.20.193.40:0/2627226743 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f0003620 con 0x7ff30c15cba0 2026-02-24T17:25:10.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc6b577640 1 -- 10.20.193.40:0/3284167119 learned_addr learned my addr 10.20.193.40:0/3284167119 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30b7fe640 1 -- 10.20.193.40:0/2627226743 >> v2:10.20.193.40:3300/0 conn(0x7ff30c0b4860 msgr2=0x7ff30c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30b7fe640 1 --2- 10.20.193.40:0/2627226743 >> v2:10.20.193.40:3300/0 conn(0x7ff30c0b4860 0x7ff30c0b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30b7fe640 1 -- 10.20.193.40:0/2627226743 >> v1:10.20.193.40:6789/0 conn(0x7ff30c15cba0 legacy=0x7ff30c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30b7fe640 1 -- 10.20.193.40:0/2627226743 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c166b70 con 0x7ff30c0566e0 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc6a575640 1 --2- 10.20.193.40:0/3284167119 >> v2:10.20.193.109:3300/0 conn(0x7fdc6c16ada0 0x7fdc6c05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc6b577640 1 -- 10.20.193.40:0/3284167119 >> v2:10.20.193.109:3300/0 conn(0x7fdc6c16ada0 msgr2=0x7fdc6c05d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc6b577640 1 --2- 10.20.193.40:0/3284167119 >> v2:10.20.193.109:3300/0 conn(0x7fdc6c16ada0 0x7fdc6c05d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc6b577640 1 -- 10.20.193.40:0/3284167119 >> v1:10.20.193.94:6789/0 conn(0x7fdc6c05d1a0 legacy=0x7fdc6c166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7fdc6b577640 1 -- 10.20.193.40:0/3284167119 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6c0b4430 con 0x7fdc6c0bc470 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f789a943640 1 Processor -- start 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f789a943640 1 -- start start 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f2691886640 1 Processor -- start 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f2691886640 1 -- start start 2026-02-24T17:25:10.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30b7fe640 1 --2- 10.20.193.40:0/2627226743 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c0566e0 0x7ff30c056ab0 secure :-1 s=READY pgs=80 gs=3 cs=0 l=1 c_cookie=1660187857144054852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff30c0bc3a0 tx=0x7ff2f801d810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=170a2c0f5d7d0444 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f789a943640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f789405d1a0 0x7f789405d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f789a943640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f789416ada0 0x7f7894166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f789a943640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7894167130 con 0x7f78940bc470 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f789a943640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f78941673c0 con 0x7f789416ada0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f789a943640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f78941676a0 con 0x7f789405d1a0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f78937fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f789416ada0 0x7f7894166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30a7fc640 1 -- 10.20.193.40:0/2627226743 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2f80b3070 con 0x7ff30c0566e0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f78937fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f789416ada0 0x7f7894166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48968/0 (socket says 10.20.193.40:48968) 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f78937fe640 1 -- 10.20.193.40:0/1408646847 learned_addr learned my addr 10.20.193.40:0/1408646847 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30a7fc640 1 -- 10.20.193.40:0/2627226743 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f80a68e0 con 0x7ff30c0566e0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7ff30a7fc640 1 -- 10.20.193.40:0/2627226743 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2f80a6cf0 con 0x7ff30c0566e0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.951+0000 7f7893fff640 1 --2- 10.20.193.40:0/1408646847 >> v2:10.20.193.109:3300/0 conn(0x7f789405d1a0 0x7f789405d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f78937fe640 1 -- 10.20.193.40:0/1408646847 >> v2:10.20.193.109:3300/0 conn(0x7f789405d1a0 msgr2=0x7f789405d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f78937fe640 1 --2- 10.20.193.40:0/1408646847 >> v2:10.20.193.109:3300/0 conn(0x7f789405d1a0 0x7f789405d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f78937fe640 1 -- 10.20.193.40:0/1408646847 >> v1:10.20.193.94:6789/0 conn(0x7f78940bc470 legacy=0x7f78940b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f78937fe640 1 -- 10.20.193.40:0/1408646847 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7894167980 con 0x7f789416ada0 2026-02-24T17:25:10.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 Processor -- start 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f268c059cb0 0x7f268c05a080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f268c15c8e0 0x7f268c15cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268c0ba520 con 0x7f268c0b63c0 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f268c166cd0 con 0x7f268c15c8e0 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- start start 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc6b577640 1 --2- 10.20.193.40:0/3284167119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c0bc470 0x7fdc6c0b4f10 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=6763219833895056979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc6c161140 tx=0x7fdc5c01d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddbc89b1930f653 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f268c0b9f60 con 0x7f268c059cb0 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc69d74640 1 -- 10.20.193.40:0/3284167119 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc5c0b3070 con 0x7fdc6c0bc470 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc69d74640 1 -- 10.20.193.40:0/3284167119 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc5c0a6a00 con 0x7fdc6c0bc470 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc69d74640 1 -- 10.20.193.40:0/3284167119 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc5c0a6e10 con 0x7fdc6c0bc470 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- 10.20.193.40:0/2627226743 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c0566e0 msgr2=0x7ff30c056ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 --2- 10.20.193.40:0/2627226743 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c0566e0 0x7ff30c056ab0 secure :-1 s=READY pgs=80 gs=3 cs=0 l=1 c_cookie=1660187857144054852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff30c0bc3a0 tx=0x7ff2f801d810 comp rx=0 tx=0).stop 2026-02-24T17:25:10.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268affd640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f268c059cb0 0x7f268c05a080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268affd640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f268c059cb0 0x7f268c05a080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:51142/0 (socket says 10.20.193.40:51142) 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268affd640 1 -- 10.20.193.40:0/2476669762 learned_addr learned my addr 10.20.193.40:0/2476669762 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- 10.20.193.40:0/2627226743 shutdown_connections 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 --2- 10.20.193.40:0/2627226743 >> v2:10.20.193.40:3300/0 conn(0x7ff30c0b4860 0x7ff30c0b4ca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 --2- 10.20.193.40:0/2627226743 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c0566e0 0x7ff30c056ab0 unknown :-1 s=CLOSED pgs=80 gs=3 cs=0 l=1 c_cookie=1660187857144054852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268b7fe640 1 --2- 10.20.193.40:0/2476669762 >> v2:10.20.193.94:3300/0 conn(0x7f268c15c8e0 0x7f268c15cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- 10.20.193.40:0/2627226743 >> 10.20.193.40:0/2627226743 conn(0x7ff30c05d030 msgr2=0x7ff30c0bd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- 10.20.193.40:0/2627226743 shutdown_connections 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- 10.20.193.40:0/2627226743 wait complete. 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4f27b3640 1 Processor -- start 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268affd640 1 -- 10.20.193.40:0/2476669762 >> v2:10.20.193.94:3300/0 conn(0x7f268c15c8e0 msgr2=0x7f268c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268affd640 1 --2- 10.20.193.40:0/2476669762 >> v2:10.20.193.94:3300/0 conn(0x7f268c15c8e0 0x7f268c15cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268affd640 1 -- 10.20.193.40:0/2476669762 >> v1:10.20.193.94:6789/0 conn(0x7f268c0b63c0 legacy=0x7f268c0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4f27b3640 1 -- start start 2026-02-24T17:25:10.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268affd640 1 -- 10.20.193.40:0/2476669762 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c0ba240 con 0x7f268c059cb0 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fed9005d1a0 0x7fed9005d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fed9016ada0 0x7fed90166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fed900bc470 0x7fed900b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fed90167130 con 0x7fed9016ada0 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fed901673c0 con 0x7fed900bc470 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fed901676a0 con 0x7fed9005d1a0 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- 10.20.193.40:0/3284167119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c0bc470 msgr2=0x7fdc6c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 --2- 10.20.193.40:0/3284167119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c0bc470 0x7fdc6c0b4f10 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=6763219833895056979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc6c161140 tx=0x7fdc5c01d960 comp rx=0 tx=0).stop 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fed9016ada0 0x7fed90166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fed9016ada0 0x7fed90166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48984/0 (socket says 10.20.193.40:48984) 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 -- 10.20.193.40:0/1850555383 learned_addr learned my addr 10.20.193.40:0/1850555383 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8ffff640 1 --2- 10.20.193.40:0/1850555383 >> v2:10.20.193.109:3300/0 conn(0x7fed9005d1a0 0x7fed9005d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed94dfc640 1 --2- 10.20.193.40:0/1850555383 >> v2:10.20.193.94:3300/0 conn(0x7fed900bc470 0x7fed900b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- 10.20.193.40:0/3284167119 shutdown_connections 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 --2- 10.20.193.40:0/3284167119 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c0bc470 0x7fdc6c0b4f10 unknown :-1 s=CLOSED pgs=128 gs=2 cs=0 l=1 c_cookie=6763219833895056979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 --2- 10.20.193.40:0/3284167119 >> v2:10.20.193.109:3300/0 conn(0x7fdc6c16ada0 0x7fdc6c05d570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.966 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- 10.20.193.40:0/3284167119 >> 10.20.193.40:0/3284167119 conn(0x7fdc6c0bd200 msgr2=0x7fdc6c0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- 10.20.193.40:0/3284167119 shutdown_connections 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 -- 10.20.193.40:0/1850555383 >> v2:10.20.193.109:3300/0 conn(0x7fed9005d1a0 msgr2=0x7fed9005d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 --2- 10.20.193.40:0/1850555383 >> v2:10.20.193.109:3300/0 conn(0x7fed9005d1a0 0x7fed9005d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 -- 10.20.193.40:0/1850555383 >> v2:10.20.193.94:3300/0 conn(0x7fed900bc470 msgr2=0x7fed900b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 --2- 10.20.193.40:0/1850555383 >> v2:10.20.193.94:3300/0 conn(0x7fed900bc470 0x7fed900b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 -- 10.20.193.40:0/1850555383 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed90167980 con 0x7fed9016ada0 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- 10.20.193.40:0/3284167119 wait complete. 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4f27b3640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fb4ec15d4b0 0x7fb4ec166ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4f27b3640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4ec167670 con 0x7fb4ec1671e0 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4f27b3640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4ec167950 con 0x7fb4ec15d880 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4f27b3640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fb4ec0b59a0 con 0x7fb4ec15d4b0 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 librados: starting msgr at 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 librados: starting objecter 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 Processor -- start 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4ebfff640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fb4ec15d4b0 0x7fb4ec166ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4ebfff640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fb4ec15d4b0 0x7fb4ec166ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51148/0 (socket says 10.20.193.40:51148) 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4ebfff640 1 -- 10.20.193.40:0/3438790588 learned_addr learned my addr 10.20.193.40:0/3438790588 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- start start 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 librados: setting wanted keys 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 librados: calling monclient init 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4ebfff640 1 -- 10.20.193.40:0/3438790588 >> v1:10.20.193.109:6789/0 conn(0x7fb4ec15d880 legacy=0x7fb4ec0b6480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4ebfff640 1 -- 10.20.193.40:0/3438790588 >> v1:10.20.193.94:6789/0 conn(0x7fb4ec1671e0 legacy=0x7fb4ec0579b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4ebfff640 1 -- 10.20.193.40:0/3438790588 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec0b5c80 con 0x7fb4ec15d4b0 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f78937fe640 1 --2- 10.20.193.40:0/1408646847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f7894166bf0 secure :-1 s=READY pgs=129 gs=2 cs=0 l=1 c_cookie=13088416214437815012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f789405dc70 tx=0x7f788401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a365339e0762e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7892ffd640 1 -- 10.20.193.40:0/1408646847 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78840a9670 con 0x7f789416ada0 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7892ffd640 1 -- 10.20.193.40:0/1408646847 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78840a9810 con 0x7f789416ada0 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7892ffd640 1 -- 10.20.193.40:0/1408646847 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78840a9c00 con 0x7f789416ada0 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- 10.20.193.40:0/1408646847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 msgr2=0x7f7894166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 --2- 10.20.193.40:0/1408646847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f7894166bf0 secure :-1 s=READY pgs=129 gs=2 cs=0 l=1 c_cookie=13088416214437815012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f789405dc70 tx=0x7f788401c5d0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- 10.20.193.40:0/1408646847 shutdown_connections 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 --2- 10.20.193.40:0/1408646847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f7894166bf0 unknown :-1 s=CLOSED pgs=129 gs=2 cs=0 l=1 c_cookie=13088416214437815012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 --2- 10.20.193.40:0/1408646847 >> v2:10.20.193.109:3300/0 conn(0x7f789405d1a0 0x7f789405d570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- 10.20.193.40:0/1408646847 >> 10.20.193.40:0/1408646847 conn(0x7f78940bd200 msgr2=0x7f78940bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- 10.20.193.40:0/1408646847 shutdown_connections 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- 10.20.193.40:0/1408646847 wait complete. 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff30c0566e0 0x7ff30c179080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff30c0b4860 0x7ff30c165860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c15cba0 0x7ff30c17a960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0b7430 con 0x7ff30c0b4860 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0b72b0 con 0x7ff30c0566e0 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c16a4c0 con 0x7ff30c15cba0 2026-02-24T17:25:10.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f268affd640 1 --2- 10.20.193.40:0/2476669762 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c05a080 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=5066960250577225567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26800090a0 tx=0x7f268001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4651758082ae075f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff30c0b4860 0x7ff30c165860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff30c0b4860 0x7ff30c165860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48986/0 (socket says 10.20.193.40:48986) 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 -- 10.20.193.40:0/2914364649 learned_addr learned my addr 10.20.193.40:0/2914364649 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30b7fe640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff30c0566e0 0x7ff30c179080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30bfff640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c15cba0 0x7ff30c17a960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2689ffb640 1 -- 10.20.193.40:0/2476669762 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26800aa460 con 0x7f268c059cb0 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2689ffb640 1 -- 10.20.193.40:0/2476669762 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26800af070 con 0x7f268c059cb0 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2689ffb640 1 -- 10.20.193.40:0/2476669762 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26800aa840 con 0x7f268c059cb0 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 -- 10.20.193.40:0/2914364649 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c15cba0 msgr2=0x7ff30c17a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 librados: starting msgr at 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 librados: starting objecter 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d38c82640 1 Processor -- start 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c15cba0 0x7ff30c17a960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 -- 10.20.193.40:0/2914364649 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff30c0566e0 msgr2=0x7ff30c179080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff30c0566e0 0x7ff30c179080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 -- 10.20.193.40:0/2914364649 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c179be0 con 0x7ff30c0b4860 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d38c82640 1 -- start start 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30bfff640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c15cba0 0x7ff30c17a960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30b7fe640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff30c0566e0 0x7ff30c179080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8f7fe640 1 --2- 10.20.193.40:0/1850555383 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9016ada0 0x7fed90166bf0 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=10902700118857636304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed900b70d0 tx=0x7fed8001c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974e2bfe3d1e59d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 Processor -- start 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 librados: starting msgr at 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 librados: starting objecter 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 Processor -- start 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- start start 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff30affd640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff30c0b4860 0x7ff30c165860 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2fc00e980 tx=0x7ff2fc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff2e7fff640 10 client.?.objecter ms_handle_connect 0x7ff30c0b4860 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff2e7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 librados: setting wanted keys 2026-02-24T17:25:10.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8effd640 1 -- 10.20.193.40:0/1850555383 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed800aa620 con 0x7fed9016ada0 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8effd640 1 -- 10.20.193.40:0/1850555383 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed800af070 con 0x7fed9016ada0 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed8effd640 1 -- 10.20.193.40:0/1850555383 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed800aaa00 con 0x7fed9016ada0 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 librados: calling monclient init 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff2e7fff640 1 -- 10.20.193.40:0/2914364649 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2fc017070 con 0x7ff30c0b4860 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 -- 10.20.193.40:0/2476669762 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 msgr2=0x7f268c05a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 --2- 10.20.193.40:0/2476669762 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c05a080 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=5066960250577225567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26800090a0 tx=0x7f268001c520 comp rx=0 tx=0).stop 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- 10.20.193.40:0/1850555383 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9016ada0 msgr2=0x7fed90166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 --2- 10.20.193.40:0/1850555383 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9016ada0 0x7fed90166bf0 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=10902700118857636304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed900b70d0 tx=0x7fed8001c590 comp rx=0 tx=0).stop 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- 10.20.193.40:0/1850555383 shutdown_connections 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 --2- 10.20.193.40:0/1850555383 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9016ada0 0x7fed90166bf0 unknown :-1 s=CLOSED pgs=130 gs=1 cs=0 l=1 c_cookie=10902700118857636304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 --2- 10.20.193.40:0/1850555383 >> v2:10.20.193.94:3300/0 conn(0x7fed900bc470 0x7fed900b4f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 --2- 10.20.193.40:0/1850555383 >> v2:10.20.193.109:3300/0 conn(0x7fed9005d1a0 0x7fed9005d570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- 10.20.193.40:0/1850555383 >> 10.20.193.40:0/1850555383 conn(0x7fed900bd200 msgr2=0x7fed900bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- 10.20.193.40:0/1850555383 shutdown_connections 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fed96886640 1 -- 10.20.193.40:0/1850555383 wait complete. 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- start start 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 librados: setting wanted keys 2026-02-24T17:25:10.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 librados: calling monclient init 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f789405d1a0 0x7f789413ef00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f78940bc470 0x7f789413f440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f789417f2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f789415d9e0 con 0x7f789416ada0 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f789415d860 con 0x7f78940bc470 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f789a943640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f78941cd510 con 0x7f789405d1a0 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f789417f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f789417f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:48990/0 (socket says 10.20.193.40:48990) 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 -- 10.20.193.40:0/756714917 learned_addr learned my addr 10.20.193.40:0/756714917 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f78937fe640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f78940bc470 0x7f789413f440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7893fff640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f789405d1a0 0x7f789413ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4ebfff640 1 --2- 10.20.193.40:0/3438790588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d4b0 0x7fb4ec166ca0 secure :-1 s=READY pgs=70 gs=3 cs=0 l=1 c_cookie=11879607392991631231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d80090a0 tx=0x7fb4d801c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4dcd7fbaa5ed77f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff2e7fff640 1 -- 10.20.193.40:0/2914364649 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2fc00cc20 con 0x7ff30c0b4860 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c13acf0 con 0x7ff30c0b4860 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff2e7fff640 1 -- 10.20.193.40:0/2914364649 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2fc013470 con 0x7ff30c0b4860 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 10 client.4506.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c17a160 con 0x7ff30c0b4860 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 librados: init done 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 -- 10.20.193.40:0/2476669762 shutdown_connections 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 --2- 10.20.193.40:0/2476669762 >> v2:10.20.193.94:3300/0 conn(0x7f268c15c8e0 0x7f268c15cd80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 --2- 10.20.193.40:0/2476669762 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c05a080 unknown :-1 s=CLOSED pgs=81 gs=2 cs=0 l=1 c_cookie=5066960250577225567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 -- 10.20.193.40:0/2476669762 >> 10.20.193.40:0/2476669762 conn(0x7f268c0bb5e0 msgr2=0x7f268c0b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 -- 10.20.193.40:0/2476669762 shutdown_connections 2026-02-24T17:25:10.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f2691886640 1 -- 10.20.193.40:0/2476669762 wait complete. 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c16a8f0 con 0x7ff30c0b4860 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4eaffd640 1 -- 10.20.193.40:0/3438790588 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4d80aa630 con 0x7fb4ec15d4b0 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 -- 10.20.193.40:0/756714917 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f789405d1a0 msgr2=0x7f789413ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f789405d1a0 0x7f789413ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 -- 10.20.193.40:0/756714917 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f78940bc470 msgr2=0x7f789413f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f78940bc470 0x7f789413f440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c05d1a0 0x7fdc6c179a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fb4eaffd640 1 -- 10.20.193.40:0/3438790588 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d80af070 con 0x7fb4ec15d4b0 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 -- 10.20.193.40:0/756714917 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789413db00 con 0x7f789416ada0 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fdc6c0bc470 0x7fdc6c165d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d38c82640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f8d3405d9b0 0x7f8d34166b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7898eb9640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f789417f2a0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f788800d920 tx=0x7f788800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7890ff9640 10 client.?.objecter ms_handle_connect 0x7f789416ada0 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7890ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc6ad76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c05d1a0 0x7fdc6c179a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d38c82640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3415d930 con 0x7f8d340b5cd0 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d38c82640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d34167230 con 0x7f8d3415d560 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fdc6c16ada0 0x7fdc6c17a950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d38c82640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8d34167510 con 0x7f8d3405d9b0 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc6ad76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c05d1a0 0x7fdc6c179a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49002/0 (socket says 10.20.193.40:49002) 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c0ba9c0 con 0x7fdc6c05d1a0 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d31d74640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f8d3405d9b0 0x7f8d34166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c15d9e0 con 0x7fdc6c16ada0 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d31d74640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f8d3405d9b0 0x7f8d34166b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49016/0 (socket says 10.20.193.40:49016) 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f8d31d74640 1 -- 10.20.193.40:0/3767741491 learned_addr learned my addr 10.20.193.40:0/3767741491 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc71151640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c15d860 con 0x7fdc6c0bc470 2026-02-24T17:25:10.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7f7890ff9640 1 -- 10.20.193.40:0/756714917 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7888005df0 con 0x7f789416ada0 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc6a575640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fdc6c0bc470 0x7fdc6c165d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.955+0000 7fdc6b577640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fdc6c16ada0 0x7fdc6c17a950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6a575640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fdc6c0bc470 0x7fdc6c165d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:51190/0 (socket says 10.20.193.40:51190) 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 librados: starting msgr at 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 librados: starting objecter 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6a575640 1 -- 10.20.193.40:0/1155938497 learned_addr learned my addr 10.20.193.40:0/1155938497 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f8d31d74640 1 -- 10.20.193.40:0/3767741491 >> v1:10.20.193.109:6789/0 conn(0x7f8d3415d560 legacy=0x7f8d3405d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f8d31d74640 1 -- 10.20.193.40:0/3767741491 >> v1:10.20.193.40:6789/0 conn(0x7f8d340b5cd0 legacy=0x7f8d340b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f8d31d74640 1 -- 10.20.193.40:0/3767741491 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d341677f0 con 0x7f8d3405d9b0 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 Processor -- start 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- 10.20.193.40:0/3438790588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d4b0 msgr2=0x7fb4ec166ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 --2- 10.20.193.40:0/3438790588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d4b0 0x7fb4ec166ca0 secure :-1 s=READY pgs=70 gs=3 cs=0 l=1 c_cookie=11879607392991631231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d80090a0 tx=0x7fb4d801c620 comp rx=0 tx=0).stop 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 -- start start 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 librados: setting wanted keys 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 librados: starting msgr at 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 librados: starting objecter 2026-02-24T17:25:10.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- 10.20.193.40:0/3438790588 shutdown_connections 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 --2- 10.20.193.40:0/3438790588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d4b0 0x7fb4ec166ca0 unknown :-1 s=CLOSED pgs=70 gs=3 cs=0 l=1 c_cookie=11879607392991631231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- 10.20.193.40:0/3438790588 >> 10.20.193.40:0/3438790588 conn(0x7fb4ec0bb2a0 msgr2=0x7fb4ec0bb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 librados: calling monclient init 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 Processor -- start 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 -- start start 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 librados: setting wanted keys 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 librados: calling monclient init 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6b577640 1 -- 10.20.193.40:0/1155938497 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fdc6c0bc470 msgr2=0x7fdc6c165d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6b577640 1 --2- 10.20.193.40:0/1155938497 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fdc6c0bc470 0x7fdc6c165d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6b577640 1 -- 10.20.193.40:0/1155938497 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c05d1a0 msgr2=0x7fdc6c179a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6b577640 1 --2- 10.20.193.40:0/1155938497 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c05d1a0 0x7fdc6c179a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6b577640 1 -- 10.20.193.40:0/1155938497 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6c17a470 con 0x7fdc6c16ada0 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- 10.20.193.40:0/3438790588 shutdown_connections 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- 10.20.193.40:0/3438790588 wait complete. 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6b577640 1 --2- 10.20.193.40:0/1155938497 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fdc6c16ada0 0x7fdc6c17a950 secure :-1 s=READY pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc5c01e200 tx=0x7fdc5c01a700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 10 client.?.objecter ms_handle_connect 0x7fdc6c16ada0 2026-02-24T17:25:10.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9005d1a0 0x7fed90179d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fed900bc470 0x7fed9017a270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fed9016ada0 0x7fed9013aaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fed900ba9c0 con 0x7fed9005d1a0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fed9015d860 con 0x7fed900bc470 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed96886640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fed900b5860 con 0x7fed9016ada0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c162ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f268c0b63c0 0x7f268c17d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f268c15c8e0 0x7f268c17ab40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0b93c0 con 0x7f268c15c8e0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0b5ea0 con 0x7f268c0b63c0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0b9540 con 0x7f268c059cb0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 1 -- 10.20.193.40:0/1155938497 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc5c0b3040 con 0x7fdc6c16ada0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 1 -- 10.20.193.40:0/1155938497 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc5c0af830 con 0x7fdc6c16ada0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789413dde0 con 0x7f789416ada0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f789a943640 10 client.4509.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f789413e3a0 con 0x7f789416ada0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f789a943640 1 librados: init done 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7894166bf0 con 0x7f789416ada0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6c162210 con 0x7fdc6c16ada0 2026-02-24T17:25:10.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 1 -- 10.20.193.40:0/1155938497 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc5c0afc20 con 0x7fdc6c16ada0 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9005d1a0 0x7fed90179d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c162ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c162ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:51196/0 (socket says 10.20.193.40:51196) 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8f7fe640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fed900bc470 0x7fed9017a270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9005d1a0 0x7fed90179d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49024/0 (socket says 10.20.193.40:49024) 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 -- 10.20.193.40:0/2571545121 learned_addr learned my addr 10.20.193.40:0/2571545121 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 -- 10.20.193.40:0/4080771846 learned_addr learned my addr 10.20.193.40:0/4080771846 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268a7fc640 1 --2- 10.20.193.40:0/2571545121 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f268c0b63c0 0x7f268c17d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc71151640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f7890ff9640 1 -- 10.20.193.40:0/756714917 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788800b910 con 0x7f789416ada0 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed94dfc640 1 --2- 10.20.193.40:0/4080771846 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fed9016ada0 0x7fed9013aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc6c1627d0 con 0x7fdc6c16ada0 2026-02-24T17:25:10.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f7890ff9640 1 -- 10.20.193.40:0/756714917 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f788800bd20 con 0x7f789416ada0 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc71151640 1 librados: init done 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 -- 10.20.193.40:0/4080771846 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fed9016ada0 msgr2=0x7fed9013aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 --2- 10.20.193.40:0/4080771846 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fed9016ada0 0x7fed9013aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 -- 10.20.193.40:0/4080771846 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fed900bc470 msgr2=0x7fed9017a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 --2- 10.20.193.40:0/4080771846 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fed900bc470 0x7fed9017a270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 -- 10.20.193.40:0/4080771846 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9017ca40 con 0x7fed9005d1a0 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 -- 10.20.193.40:0/2571545121 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f268c0b63c0 msgr2=0x7f268c17d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 --2- 10.20.193.40:0/2571545121 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f268c0b63c0 0x7f268c17d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 -- 10.20.193.40:0/2571545121 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f268c15c8e0 msgr2=0x7f268c17ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 --2- 10.20.193.40:0/2571545121 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f268c15c8e0 0x7f268c17ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 -- 10.20.193.40:0/2571545121 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c163250 con 0x7f268c059cb0 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 librados: starting msgr at 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 librados: starting objecter 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8ffff640 1 --2- 10.20.193.40:0/4080771846 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9005d1a0 0x7fed90179d30 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed7c009460 tx=0x7fed7c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8cff9640 10 client.?.objecter ms_handle_connect 0x7fed9005d1a0 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fed8cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 Processor -- start 2026-02-24T17:25:10.979 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268affd640 1 --2- 10.20.193.40:0/2571545121 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c162ba0 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2680004780 tx=0x7f268001ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f8d31d74640 1 --2- 10.20.193.40:0/3767741491 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3405d9b0 0x7f8d34166b40 secure :-1 s=READY pgs=135 gs=3 cs=0 l=1 c_cookie=7142947959359273195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d1c0090a0 tx=0x7f8d1c01c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6320d952f6b5f8eb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- start start 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 librados: setting wanted keys 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 librados: calling monclient init 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 10 client.?.objecter ms_handle_connect 0x7f268c059cb0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc6c15c8a0 con 0x7fdc6c16ada0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 1 -- 10.20.193.40:0/2571545121 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2680004240 con 0x7f268c059cb0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 1 -- 10.20.193.40:0/2571545121 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26800043e0 con 0x7f268c059cb0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 1 -- 10.20.193.40:0/2571545121 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2680003950 con 0x7f268c059cb0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c163530 con 0x7f268c059cb0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c163af0 con 0x7f268c059cb0 2026-02-24T17:25:10.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 librados: init done 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb4ec15d4b0 0x7fb4ec162970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d880 0x7fb4ec059a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4ec1671e0 0x7fb4ec11fc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1ce960 con 0x7fb4ec1671e0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1ce7e0 con 0x7fb4ec15d880 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec1ceae0 con 0x7fb4ec15d4b0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4ec1671e0 0x7fb4ec11fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4ec1671e0 0x7fb4ec11fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49038/0 (socket says 10.20.193.40:49038) 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 -- 10.20.193.40:0/4033743813 learned_addr learned my addr 10.20.193.40:0/4033743813 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4eb7fe640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d880 0x7fb4ec059a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4ebfff640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb4ec15d4b0 0x7fb4ec162970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 -- 10.20.193.40:0/4033743813 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb4ec15d4b0 msgr2=0x7fb4ec162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb4ec15d4b0 0x7fb4ec162970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 -- 10.20.193.40:0/4033743813 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d880 msgr2=0x7fb4ec059a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d880 0x7fb4ec059a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 -- 10.20.193.40:0/4033743813 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec163290 con 0x7fb4ec1671e0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f268c15d6d0 con 0x7f268c059cb0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f0d29640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4ec1671e0 0x7fb4ec11fc40 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4e000c9b0 tx=0x7fb4e000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4e8ff9640 10 client.?.objecter ms_handle_connect 0x7fb4ec1671e0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4e8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 1 -- 10.20.193.40:0/1155938497 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fdc5c0b6030 con 0x7fdc6c16ada0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 1 --2- 10.20.193.40:0/1155938497 >> v2:10.20.193.120:6800/397309233 conn(0x7fdc38074070 0x7fdc38094520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 1 -- 10.20.193.40:0/1155938497 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fdc5c0bf020 con 0x7fdc6c16ada0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 10 client.4462.objecter ms_dispatch2 0x7fdc6c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 3 client.4462.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 3 client.4462.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc4b7fe640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 1 -- 10.20.193.40:0/2571545121 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f2680003af0 con 0x7f268c059cb0 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6ad76640 1 --2- 10.20.193.40:0/1155938497 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c05d1a0 0x7fdc6c179a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 1 -- 10.20.193.40:0/2914364649 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7ff2fc013610 con 0x7ff30c0b4860 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 1 --2- 10.20.193.40:0/2914364649 >> v2:10.20.193.120:6800/397309233 conn(0x7ff2dc074240 0x7ff2dc0946f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 1 -- 10.20.193.40:0/2914364649 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7ff2fc00f040 con 0x7ff30c0b4860 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 10 client.4506.objecter ms_dispatch2 0x7ff30c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 3 client.4506.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 3 client.4506.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 20 client.4506.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff30b7fe640 1 --2- 10.20.193.40:0/2914364649 >> v2:10.20.193.120:6800/397309233 conn(0x7ff2dc074240 0x7ff2dc0946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 10 client.4506.objecter ms_handle_connect 0x7ff2dc074240 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff30b7fe640 1 --2- 10.20.193.40:0/2914364649 >> v2:10.20.193.120:6800/397309233 conn(0x7ff2dc074240 0x7ff2dc0946f0 secure :-1 s=READY pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f801d850 tx=0x7ff2f80a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7ff2e7fff640 1 -- 10.20.193.40:0/2914364649 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7ff2fc0611a0 con 0x7ff30c0b4860 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fdc6ad76640 1 --2- 10.20.193.40:0/1155938497 >> v2:10.20.193.120:6800/397309233 conn(0x7fdc38074070 0x7fdc38094520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 1 --2- 10.20.193.40:0/2571545121 >> v2:10.20.193.120:6800/397309233 conn(0x7f265c0741d0 0x7f265c094680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 1 -- 10.20.193.40:0/2571545121 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f2680130ed0 con 0x7f268c059cb0 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 10 client.4478.objecter ms_dispatch2 0x7f268c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 3 client.4478.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f8d31573640 1 -- 10.20.193.40:0/3767741491 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d1c0ab640 con 0x7f8d3405d9b0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 3 client.4478.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f2663fff640 20 client.4478.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4e8ff9640 1 -- 10.20.193.40:0/4033743813 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4e000db40 con 0x7fb4ec1671e0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ec163570 con 0x7fb4ec1671e0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 10 client.4518.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ec163b30 con 0x7fb4ec1671e0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7fb4f27b3640 1 librados: init done 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.959+0000 7f268a7fc640 1 --2- 10.20.193.40:0/2571545121 >> v2:10.20.193.120:6800/397309233 conn(0x7f265c0741d0 0x7f265c094680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f2663fff640 10 client.4478.objecter ms_handle_connect 0x7f265c0741d0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f268a7fc640 1 --2- 10.20.193.40:0/2571545121 >> v2:10.20.193.120:6800/397309233 conn(0x7f265c0741d0 0x7f265c094680 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f268c167930 tx=0x7f2674009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ec166ca0 con 0x7fb4ec1671e0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fdc4b7fe640 10 client.4462.objecter ms_handle_connect 0x7fdc38074070 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fdc6ad76640 1 --2- 10.20.193.40:0/1155938497 >> v2:10.20.193.120:6800/397309233 conn(0x7fdc38074070 0x7fdc38094520 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc60004740 tx=0x7fdc60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7890ff9640 1 -- 10.20.193.40:0/756714917 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f7888024060 con 0x7f789416ada0 2026-02-24T17:25:10.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 1 -- 10.20.193.40:0/4080771846 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed7c017070 con 0x7fed9005d1a0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 1 -- 10.20.193.40:0/4080771846 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c00ee50 con 0x7fed9005d1a0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 1 -- 10.20.193.40:0/4080771846 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed7c00cda0 con 0x7fed9005d1a0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9017bec0 con 0x7fed9005d1a0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed96886640 10 client.4515.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9017c480 con 0x7fed9005d1a0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed96886640 1 librados: init done 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7890ff9640 1 --2- 10.20.193.40:0/756714917 >> v2:10.20.193.120:6800/397309233 conn(0x7f78640741d0 0x7f7864094680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7890ff9640 1 -- 10.20.193.40:0/756714917 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f7888097b00 con 0x7f789416ada0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7890ff9640 10 client.4509.objecter ms_dispatch2 0x7f7894000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7890ff9640 3 client.4509.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7890ff9640 3 client.4509.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7890ff9640 20 client.4509.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed90166bf0 con 0x7fed9005d1a0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7893fff640 1 -- 10.20.193.40:0/756714917 >> v2:10.20.193.120:6800/397309233 conn(0x7f78640741d0 msgr2=0x7f7864094680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7893fff640 1 -- 10.20.193.40:0/756714917 >> v2:10.20.193.120:6800/397309233 conn(0x7f78640741d0 msgr2=0x7f7864094680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7893fff640 1 --2- 10.20.193.40:0/756714917 >> v2:10.20.193.120:6800/397309233 conn(0x7f78640741d0 0x7f7864094680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7893fff640 1 --2- 10.20.193.40:0/756714917 >> v2:10.20.193.120:6800/397309233 conn(0x7f78640741d0 0x7f7864094680 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fb4e8ff9640 1 -- 10.20.193.40:0/4033743813 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e0011070 con 0x7fb4ec1671e0 2026-02-24T17:25:10.984 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fb4e8ff9640 1 -- 10.20.193.40:0/4033743813 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4e0016470 con 0x7fb4ec1671e0 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d31573640 1 -- 10.20.193.40:0/3767741491 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c0b0070 con 0x7f8d3405d9b0 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d31573640 1 -- 10.20.193.40:0/3767741491 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d1c0aba20 con 0x7f8d3405d9b0 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- 10.20.193.40:0/3767741491 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3405d9b0 msgr2=0x7f8d34166b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 --2- 10.20.193.40:0/3767741491 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3405d9b0 0x7f8d34166b40 secure :-1 s=READY pgs=135 gs=3 cs=0 l=1 c_cookie=7142947959359273195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d1c0090a0 tx=0x7f8d1c01c620 comp rx=0 tx=0).stop 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fdc4b7fe640 1 -- 10.20.193.40:0/1155938497 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fdc5c0c8020 con 0x7fdc6c16ada0 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- 10.20.193.40:0/3767741491 shutdown_connections 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 --2- 10.20.193.40:0/3767741491 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3405d9b0 0x7f8d34166b40 unknown :-1 s=CLOSED pgs=135 gs=3 cs=0 l=1 c_cookie=7142947959359273195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- 10.20.193.40:0/3767741491 >> 10.20.193.40:0/3767741491 conn(0x7f8d340b8a00 msgr2=0x7f8d340598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- 10.20.193.40:0/3767741491 shutdown_connections 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f2663fff640 1 -- 10.20.193.40:0/2571545121 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f26800161d0 con 0x7f268c059cb0 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f7890ff9640 1 -- 10.20.193.40:0/756714917 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f7888061940 con 0x7f789416ada0 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- 10.20.193.40:0/3767741491 wait complete. 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 librados: starting msgr at 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 librados: starting objecter 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 Processor -- start 2026-02-24T17:25:10.985 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 1 -- 10.20.193.40:0/4080771846 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fed7c024060 con 0x7fed9005d1a0 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- start start 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 librados: setting wanted keys 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 librados: calling monclient init 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8d3405d9b0 0x7f8d34161e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8d340b5cd0 0x7f8d34129150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3415d560 0x7f8d341613c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340ab3e0 con 0x7f8d3415d560 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340ab260 con 0x7f8d3405d9b0 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d38c82640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340ab560 con 0x7f8d340b5cd0 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d32d76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3415d560 0x7f8d341613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d32d76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3415d560 0x7f8d341613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49046/0 (socket says 10.20.193.40:49046) 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d32d76640 1 -- 10.20.193.40:0/2073207847 learned_addr learned my addr 10.20.193.40:0/2073207847 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d31d74640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8d340b5cd0 0x7f8d34129150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7f8d32575640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8d3405d9b0 0x7f8d34161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 1 --2- 10.20.193.40:0/4080771846 >> v2:10.20.193.120:6800/397309233 conn(0x7fed600741d0 0x7fed60094680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 1 -- 10.20.193.40:0/4080771846 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fed7c00f040 con 0x7fed9005d1a0 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 10 client.4515.objecter ms_dispatch2 0x7fed90000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 3 client.4515.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.963+0000 7fed8cff9640 3 client.4515.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d32d76640 1 -- 10.20.193.40:0/2073207847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8d340b5cd0 msgr2=0x7f8d34129150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d32d76640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8d340b5cd0 0x7f8d34129150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d32d76640 1 -- 10.20.193.40:0/2073207847 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8d3405d9b0 msgr2=0x7f8d34161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d32d76640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8d3405d9b0 0x7f8d34161e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d32d76640 1 -- 10.20.193.40:0/2073207847 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d34162400 con 0x7f8d3415d560 2026-02-24T17:25:10.986 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fed8cff9640 20 client.4515.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d32d76640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3415d560 0x7f8d341613c0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2400d8f0 tx=0x7f8d2400ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d1affd640 10 client.?.objecter ms_handle_connect 0x7f8d3415d560 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d1affd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fed8f7fe640 1 --2- 10.20.193.40:0/4080771846 >> v2:10.20.193.120:6800/397309233 conn(0x7fed600741d0 0x7fed60094680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fed8f7fe640 1 --2- 10.20.193.40:0/4080771846 >> v2:10.20.193.120:6800/397309233 conn(0x7fed600741d0 0x7fed60094680 secure :-1 s=READY pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed80009690 tx=0x7fed800a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fed8cff9640 10 client.4515.objecter ms_handle_connect 0x7fed600741d0 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f45026af640 1 Processor -- start 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f45026af640 1 -- start start 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 1 -- 10.20.193.40:0/4033743813 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fb4e001e030 con 0x7fb4ec1671e0 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 1 --2- 10.20.193.40:0/4033743813 >> v2:10.20.193.120:6800/397309233 conn(0x7fb4bc0740f0 0x7fb4bc0945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 1 -- 10.20.193.40:0/4033743813 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fb4e0096f60 con 0x7fb4ec1671e0 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 10 client.4518.objecter ms_dispatch2 0x7fb4ec000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 3 client.4518.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 3 client.4518.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 20 client.4518.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4ebfff640 1 --2- 10.20.193.40:0/4033743813 >> v2:10.20.193.120:6800/397309233 conn(0x7fb4bc0740f0 0x7fb4bc0945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.987 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fed8cff9640 1 -- 10.20.193.40:0/4080771846 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fed7c0602a0 con 0x7fed9005d1a0 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f45026af640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc1673c0 con 0x7f44fc05d570 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f4500c25640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f44fc05d570 0x7f44fc0b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45740/0 (socket says 10.20.193.40:45740) 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f4500c25640 1 -- 10.20.193.40:0/3697640893 learned_addr learned my addr 10.20.193.40:0/3697640893 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f45026af640 1 -- 10.20.193.40:0/3697640893 --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc1676a0 con 0x7f44fc16ada0 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f45026af640 1 -- 10.20.193.40:0/3697640893 --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc167980 con 0x7f44fc05d1a0 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4ebfff640 1 --2- 10.20.193.40:0/4033743813 >> v2:10.20.193.120:6800/397309233 conn(0x7fb4bc0740f0 0x7fb4bc0945a0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d801c450 tx=0x7fb4d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 10 client.4518.objecter ms_handle_connect 0x7fb4bc0740f0 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753796158 0 0) 0x7f44fc167980 con 0x7f44fc05d1a0 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e0003620 con 0x7f44fc05d1a0 2026-02-24T17:25:10.988 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3513542332 0 0) 0x7f44fc1676a0 con 0x7f44fc16ada0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44fc167980 con 0x7f44fc16ada0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 <== mon.2 v1:10.20.193.109:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2164458578 0 0) 0x7f44e0003620 con 0x7f44fc05d1a0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 >> v1:10.20.193.94:6789/0 conn(0x7f44fc16ada0 legacy=0x7f44fc0bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 >> v1:10.20.193.40:6789/0 conn(0x7f44fc05d570 legacy=0x7f44fc0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 --> v1:10.20.193.109:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc0b4430 con 0x7f44fc05d1a0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 <== mon.2 v1:10.20.193.109:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f44e8002e80 con 0x7f44fc05d1a0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 >> v1:10.20.193.109:6789/0 conn(0x7f44fc05d1a0 legacy=0x7f44fc166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44e0003d80 0x7f44e0004150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e00048d0 0x7f44e0004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44e0005480 0x7f44e0065ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0066360 con 0x7f44e00048d0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0066510 con 0x7f44e0005480 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0066710 con 0x7f44e0003d80 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44fb7fe640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e00048d0 0x7f44e0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f4500c25640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44e0005480 0x7f44e0065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f44fbfff640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44e0003d80 0x7f44e0004150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f4500c25640 1 -- 10.20.193.40:0/3697640893 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44e0003d80 msgr2=0x7f44e0004150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f4500c25640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44e0003d80 0x7f44e0004150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f4500c25640 1 -- 10.20.193.40:0/3697640893 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e00048d0 msgr2=0x7f44e0004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f4500c25640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e00048d0 0x7f44e0004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f4500c25640 1 -- 10.20.193.40:0/3697640893 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e0003620 con 0x7f44e0005480 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f00cdb53640 1 Processor -- start 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7fb4e8ff9640 1 -- 10.20.193.40:0/4033743813 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fb4e0060dd0 con 0x7fb4ec1671e0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f00cdb53640 1 -- start start 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f00c816ada0 0x7f00c805d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f00c80bc470 0x7f00c80b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00c81673c0 con 0x7f00c805d1a0 2026-02-24T17:25:10.989 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f4500c25640 1 -- 10.20.193.40:0/3697640893 reap_dead start 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f4500c25640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44e0005480 0x7f44e0065ab0 secure :-1 s=READY pgs=73 gs=6 cs=0 l=1 c_cookie=15856225210022061289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44f0004ba0 tx=0x7f44f001db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc0ca0d191f564e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d1affd640 1 -- 10.20.193.40:0/2073207847 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d24017020 con 0x7f8d3415d560 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d341626e0 con 0x7f8d3415d560 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d38c82640 10 client.4521.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d34162ca0 con 0x7f8d3415d560 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d38c82640 1 librados: init done 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d1affd640 1 -- 10.20.193.40:0/2073207847 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2400ba70 con 0x7f8d3415d560 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.967+0000 7f8d1affd640 1 -- 10.20.193.40:0/2073207847 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d2400be40 con 0x7f8d3415d560 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f00c81676a0 con 0x7f00c80bc470 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f00c8167980 con 0x7f00c816ada0 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d340b8410 con 0x7f8d3415d560 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c6ffd640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f00c816ada0 0x7f00c805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c6ffd640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f00c816ada0 0x7f00c805d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:51258/0 (socket says 10.20.193.40:51258) 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c6ffd640 1 -- 10.20.193.40:0/235626476 learned_addr learned my addr 10.20.193.40:0/235626476 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44f00047f0 con 0x7f44e0005480 2026-02-24T17:25:10.990 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44faffd640 1 -- 10.20.193.40:0/3697640893 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f00aa070 con 0x7f44e0005480 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c7fff640 1 --2- 10.20.193.40:0/235626476 >> v2:10.20.193.94:3300/0 conn(0x7f00c80bc470 0x7f00c80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c6ffd640 1 -- 10.20.193.40:0/235626476 >> v2:10.20.193.94:3300/0 conn(0x7f00c80bc470 msgr2=0x7f00c80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c6ffd640 1 --2- 10.20.193.40:0/235626476 >> v2:10.20.193.94:3300/0 conn(0x7f00c80bc470 0x7f00c80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c6ffd640 1 -- 10.20.193.40:0/235626476 >> v1:10.20.193.40:6789/0 conn(0x7f00c805d1a0 legacy=0x7f00c8166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c6ffd640 1 -- 10.20.193.40:0/235626476 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c80b4430 con 0x7f00c816ada0 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f9099415640 1 Processor -- start 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- 10.20.193.40:0/3697640893 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44e0005480 msgr2=0x7f44e0065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44e0005480 0x7f44e0065ab0 secure :-1 s=READY pgs=73 gs=6 cs=0 l=1 c_cookie=15856225210022061289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44f0004ba0 tx=0x7f44f001db30 comp rx=0 tx=0).stop 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f9099415640 1 -- start start 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- 10.20.193.40:0/3697640893 shutdown_connections 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 --2- 10.20.193.40:0/3697640893 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44e0005480 0x7f44e0065ab0 unknown :-1 s=CLOSED pgs=73 gs=6 cs=0 l=1 c_cookie=15856225210022061289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- 10.20.193.40:0/3697640893 >> 10.20.193.40:0/3697640893 conn(0x7f44fc0bd200 msgr2=0x7f44fc0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- 10.20.193.40:0/3697640893 shutdown_connections 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- 10.20.193.40:0/3697640893 wait complete. 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d1affd640 1 -- 10.20.193.40:0/2073207847 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f8d24006080 con 0x7f8d3415d560 2026-02-24T17:25:10.991 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7ff06b7fe640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 0x7ff03c0ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d1affd640 1 --2- 10.20.193.40:0/2073207847 >> v2:10.20.193.120:6800/397309233 conn(0x7f8d000740f0 0x7f8d000945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f9099415640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f9094161a10 0x7f909405a0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7ff06b7fe640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 0x7ff03c0ba450 crc :-1 s=READY pgs=8 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7ff043fff640 10 client.4433.objecter ms_handle_connect 0x7ff03c09a020 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d1affd640 1 -- 10.20.193.40:0/2073207847 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f8d240973c0 con 0x7f8d3415d560 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d1affd640 10 client.4521.objecter ms_dispatch2 0x7f8d34000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d1affd640 3 client.4521.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d1affd640 3 client.4521.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f9099415640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90940b9fa0 con 0x7f9094059cd0 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f9099415640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90940ba280 con 0x7f90940b6b60 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f9099415640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f909416b180 con 0x7f9094161a10 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f90937fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f9094161a10 0x7f909405a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d32575640 1 --2- 10.20.193.40:0/2073207847 >> v2:10.20.193.120:6800/397309233 conn(0x7f8d000740f0 0x7f8d000945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f90937fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f9094161a10 0x7f909405a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49066/0 (socket says 10.20.193.40:49066) 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f90937fe640 1 -- 10.20.193.40:0/782573896 learned_addr learned my addr 10.20.193.40:0/782573896 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.992 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d1affd640 20 client.4521.objecter dump_active .. 0 homeless 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 librados: starting msgr at 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 librados: starting objecter 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f90937fe640 1 -- 10.20.193.40:0/782573896 >> v1:10.20.193.94:6789/0 conn(0x7f90940b6b60 legacy=0x7f9094161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f90937fe640 1 -- 10.20.193.40:0/782573896 >> v1:10.20.193.40:6789/0 conn(0x7f9094059cd0 legacy=0x7f90940b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f90937fe640 1 -- 10.20.193.40:0/782573896 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90940b5970 con 0x7f9094161a10 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 Processor -- start 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- start start 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 librados: setting wanted keys 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 librados: calling monclient init 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f9fc8640 1 Processor -- start 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d1affd640 10 client.4521.objecter ms_handle_connect 0x7f8d000740f0 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f8d32575640 1 --2- 10.20.193.40:0/2073207847 >> v2:10.20.193.120:6800/397309233 conn(0x7f8d000740f0 0x7f8d000945a0 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d280047a0 tx=0x7f8d28009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.993 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f9fc8640 1 -- start start 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 <== osd.7 v2:10.20.193.120:6813/1724095478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7ff060005e50 con 0x7ff03c09a020 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7ff043fff640 10 client.4433.objecter ms_dispatch2 0x7ff06c000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7ff043fff640 10 client.4433.objecter _finish_command 1 = system:0 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7ff043fff640 20 client.4433.objecter put_session s=0x7ff03c099970 osd=7 4 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7ff043fff640 15 client.4433.objecter _session_command_op_remove 7 1 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e0005480 0x7f44fc1392a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44fc1397e0 0x7f44fc165ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44fc14b2a0 0x7f44fc166220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc0b49f0 con 0x7f44e0005480 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc05d940 con 0x7f44fc14b2a0 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f45026af640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc166bf0 con 0x7f44fc1397e0 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c6ffd640 1 --2- 10.20.193.40:0/235626476 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c816ada0 0x7f00c805d570 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=7641727973688918575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c8161140 tx=0x7f00b801c5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a0cdf1abde4c22f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e0005480 0x7f44fc1392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84de4fe640 1 Processor -- start 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e0005480 0x7f44fc1392a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49072/0 (socket says 10.20.193.40:49072) 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 -- 10.20.193.40:0/1386064966 learned_addr learned my addr 10.20.193.40:0/1386064966 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fb7fe640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44fc1397e0 0x7f44fc165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.994 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84de4fe640 1 -- start start 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c67fc640 1 -- 10.20.193.40:0/235626476 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00b80aa620 con 0x7f00c816ada0 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c67fc640 1 -- 10.20.193.40:0/235626476 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b80af070 con 0x7f00c816ada0 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00c67fc640 1 -- 10.20.193.40:0/235626476 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00b80aaa00 con 0x7f00c816ada0 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f9fc8640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 0x7f34f40b36a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f9fc8640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f34f40b3be0 0x7f34f4164dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 -- 10.20.193.40:0/235626476 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c816ada0 msgr2=0x7f00c805d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 --2- 10.20.193.40:0/235626476 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c816ada0 0x7f00c805d570 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=7641727973688918575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c8161140 tx=0x7f00b801c5d0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f4500c25640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44fc14b2a0 0x7f44fc166220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 -- 10.20.193.40:0/1386064966 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44fc1397e0 msgr2=0x7f44fc165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44fc1397e0 0x7f44fc165ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 -- 10.20.193.40:0/1386064966 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44fc14b2a0 msgr2=0x7f44fc166220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44fc14b2a0 0x7f44fc166220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 -- 10.20.193.40:0/1386064966 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc164c40 con 0x7f44e0005480 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44fbfff640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e0005480 0x7f44fc1392a0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e8003210 tx=0x7f44e8006300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44f8ff9640 10 client.?.objecter ms_handle_connect 0x7f44e0005480 2026-02-24T17:25:10.995 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f44f8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f9fc8640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f34f415b390 0x7f34f4165310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f9fc8640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f34f40b4150 con 0x7f34f40b3be0 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f9fc8640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f34f40b4430 con 0x7f34f415b390 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f9fc8640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f34f40b4710 con 0x7f34f415afc0 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f2ffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f34f40b3be0 0x7f34f4164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 -- 10.20.193.40:0/235626476 shutdown_connections 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 --2- 10.20.193.40:0/235626476 >> v2:10.20.193.94:3300/0 conn(0x7f00c80bc470 0x7f00c80b4f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 --2- 10.20.193.40:0/235626476 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c816ada0 0x7f00c805d570 unknown :-1 s=CLOSED pgs=84 gs=2 cs=0 l=1 c_cookie=7641727973688918575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 -- 10.20.193.40:0/235626476 >> 10.20.193.40:0/235626476 conn(0x7f00c80bd200 msgr2=0x7f00c80bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f37fe640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 0x7f34f40b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f2ffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f34f40b3be0 0x7f34f4164dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49076/0 (socket says 10.20.193.40:49076) 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f2ffd640 1 -- 10.20.193.40:0/878480852 learned_addr learned my addr 10.20.193.40:0/878480852 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f90937fe640 1 --2- 10.20.193.40:0/782573896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 0x7f909405a0a0 secure :-1 s=READY pgs=141 gs=3 cs=0 l=1 c_cookie=17404744707916110367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f908400adb0 tx=0x7f908401d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18a1318f9b31a1f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f3fff640 1 --2- 10.20.193.40:0/878480852 >> v2:10.20.193.94:3300/0 conn(0x7f34f415b390 0x7f34f4165310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f37fe640 1 -- 10.20.193.40:0/878480852 >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 msgr2=0x7f34f40b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f37fe640 1 -- 10.20.193.40:0/878480852 >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 msgr2=0x7f34f40b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f37fe640 1 --2- 10.20.193.40:0/878480852 >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 0x7f34f40b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f37fe640 1 --2- 10.20.193.40:0/878480852 >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 0x7f34f40b36a0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:25:10.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f2ffd640 1 -- 10.20.193.40:0/878480852 >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 msgr2=0x7f34f40b36a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f2ffd640 1 --2- 10.20.193.40:0/878480852 >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 0x7f34f40b36a0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f2ffd640 1 -- 10.20.193.40:0/878480852 >> v2:10.20.193.94:3300/0 conn(0x7f34f415b390 msgr2=0x7f34f4165310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f2ffd640 1 --2- 10.20.193.40:0/878480852 >> v2:10.20.193.94:3300/0 conn(0x7f34f415b390 0x7f34f4165310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f34f2ffd640 1 -- 10.20.193.40:0/878480852 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f40b49f0 con 0x7f34f40b3be0 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84de4fe640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d81652a0 con 0x7f84d80574d0 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84de4fe640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d8165580 con 0x7f84d80544f0 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84de4fe640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d8058080 con 0x7f84d80548c0 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84dca74640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f84d80574d0 0x7f84d815acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45758/0 (socket says 10.20.193.40:45758) 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84dca74640 1 -- 10.20.193.40:0/1267674317 learned_addr learned my addr 10.20.193.40:0/1267674317 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84d7fff640 1 --1- 10.20.193.40:0/1267674317 >> v1:10.20.193.94:6789/0 conn(0x7f84d80544f0 0x7f84d8058b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:59796/0 (socket says 10.20.193.40:59796) 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 -- 10.20.193.40:0/235626476 shutdown_connections 2026-02-24T17:25:10.997 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f00cdb53640 1 -- 10.20.193.40:0/235626476 wait complete. 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572996025 0 0) 0x7f84d8165580 con 0x7f84d80544f0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84bc003620 con 0x7f84d80544f0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991613932 0 0) 0x7f84d8058080 con 0x7f84d80548c0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.971+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d8165580 con 0x7f84d80548c0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 <== mon.1 v1:10.20.193.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1434072394 0 0) 0x7f84bc003620 con 0x7f84d80544f0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 >> v1:10.20.193.109:6789/0 conn(0x7f84d80548c0 legacy=0x7f84d8164880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 >> v1:10.20.193.40:6789/0 conn(0x7f84d80574d0 legacy=0x7f84d815acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 --> v1:10.20.193.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d8058360 con 0x7f84d80544f0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 <== mon.1 v1:10.20.193.94:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f84c4002e80 con 0x7f84d80544f0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 >> v1:10.20.193.94:6789/0 conn(0x7f84d80544f0 legacy=0x7f84d8058b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc004db0 0x7f84bc005180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84bc0038a0 0x7f84bc003d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84bc004450 0x7f84bc069fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc06a870 con 0x7f84bc0038a0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc06aa20 con 0x7f84bc004450 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc06ac20 con 0x7f84bc004db0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d77fe640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84bc0038a0 0x7f84bc003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d7fff640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc004db0 0x7f84bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84dca74640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84bc004450 0x7f84bc069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f88be1640 1 Processor -- start 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d77fe640 1 -- 10.20.193.40:0/1267674317 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc004db0 msgr2=0x7f84bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f88be1640 1 -- start start 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d77fe640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc004db0 0x7f84bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d77fe640 1 -- 10.20.193.40:0/1267674317 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84bc004450 msgr2=0x7f84bc069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d77fe640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84bc004450 0x7f84bc069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84dca74640 1 -- 10.20.193.40:0/1267674317 reap_dead start 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d77fe640 1 -- 10.20.193.40:0/1267674317 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc003620 con 0x7f84bc0038a0 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 librados: starting msgr at 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 librados: starting objecter 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 Processor -- start 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f2ffd640 1 --2- 10.20.193.40:0/878480852 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f40b3be0 0x7f34f4164dd0 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=5950600529903994937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34f40b2e90 tx=0x7f34e401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5294c7a7812dc839 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 -- start start 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 librados: setting wanted keys 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 librados: calling monclient init 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f8d1affd640 1 -- 10.20.193.40:0/2073207847 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f8d24021070 con 0x7f8d3415d560 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 1 -- 10.20.193.40:0/1386064966 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44e8018e00 con 0x7f44e0005480 2026-02-24T17:25:10.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c805d1a0 0x7f00c8180170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00c80bc470 0x7f00c8163ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00c816ada0 0x7f00c80b78b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f00c815d9e0 con 0x7f00c816ada0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f00c815d860 con 0x7f00c80bc470 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00cdb53640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f00c81cd510 con 0x7f00c805d1a0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f88be1640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f6f8405d1a0 0x7f6f8405d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f88be1640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f6f8416ada0 0x7f6f84166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f88be1640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f84167130 con 0x7f6f840bc470 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f88be1640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6f841673c0 con 0x7f6f8416ada0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f88be1640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f6f841676a0 con 0x7f6f8405d1a0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00c816ada0 0x7f00c80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00c816ada0 0x7f00c80b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49094/0 (socket says 10.20.193.40:49094) 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 -- 10.20.193.40:0/3672176179 learned_addr learned my addr 10.20.193.40:0/3672176179 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c6ffd640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00c80bc470 0x7f00c8163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c77fe640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c805d1a0 0x7f00c8180170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81d74640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f6f8416ada0 0x7f6f84166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81d74640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f6f8416ada0 0x7f6f84166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51266/0 (socket says 10.20.193.40:51266) 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81d74640 1 -- 10.20.193.40:0/1775059843 learned_addr learned my addr 10.20.193.40:0/1775059843 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f82575640 1 --2- 10.20.193.40:0/1775059843 >> v2:10.20.193.109:3300/0 conn(0x7f6f8405d1a0 0x7f6f8405d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d77fe640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84bc0038a0 0x7f84bc003d10 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=6599090695033111621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c8002fa0 tx=0x7f84c801f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b94ae060e08c445 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc164f20 con 0x7f44e0005480 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f45026af640 10 client.4527.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc1654e0 con 0x7f44e0005480 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f45026af640 1 librados: init done 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44fc167600 con 0x7f44e0005480 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9091ffb640 1 -- 10.20.193.40:0/782573896 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90840b3070 con 0x7f9094161a10 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 -- 10.20.193.40:0/3672176179 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c805d1a0 msgr2=0x7f00c8180170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c805d1a0 0x7f00c8180170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 -- 10.20.193.40:0/3672176179 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00c80bc470 msgr2=0x7f00c8163ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00c80bc470 0x7f00c8163ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 -- 10.20.193.40:0/3672176179 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c817eb10 con 0x7f00c816ada0 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c77fe640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c805d1a0 0x7f00c8180170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 1 -- 10.20.193.40:0/1386064966 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e801c030 con 0x7f44e0005480 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 1 -- 10.20.193.40:0/1386064966 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44e8026060 con 0x7f44e0005480 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00a3fff640 10 client.?.objecter ms_handle_connect 0x7f00c816ada0 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00a3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f00c7fff640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00c816ada0 0x7f00c80b78b0 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00bc00a4c0 tx=0x7f00bc00f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9091ffb640 1 -- 10.20.193.40:0/782573896 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90840a6850 con 0x7f9094161a10 2026-02-24T17:25:11.001 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9091ffb640 1 -- 10.20.193.40:0/782573896 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90840a6c60 con 0x7f9094161a10 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84c8007ce0 con 0x7f84bc0038a0 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81573640 1 -- 10.20.193.40:0/1775059843 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274299836 0 0) 0x7f6f84167130 con 0x7f6f840bc470 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81573640 1 -- 10.20.193.40:0/1775059843 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f70003620 con 0x7f6f840bc470 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f27fc640 1 -- 10.20.193.40:0/878480852 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34e40aa6a0 con 0x7f34f40b3be0 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81d74640 1 -- 10.20.193.40:0/1775059843 >> v2:10.20.193.109:3300/0 conn(0x7f6f8405d1a0 msgr2=0x7f6f8405d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81d74640 1 --2- 10.20.193.40:0/1775059843 >> v2:10.20.193.109:3300/0 conn(0x7f6f8405d1a0 0x7f6f8405d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81d74640 1 -- 10.20.193.40:0/1775059843 >> v1:10.20.193.94:6789/0 conn(0x7f6f840bc470 legacy=0x7f6f840b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f6f81d74640 1 -- 10.20.193.40:0/1775059843 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84167980 con 0x7f6f8416ada0 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f27fc640 1 -- 10.20.193.40:0/878480852 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e40af070 con 0x7f34f40b3be0 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f27fc640 1 -- 10.20.193.40:0/878480852 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34e40aaa80 con 0x7f34f40b3be0 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9099415640 1 -- 10.20.193.40:0/782573896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 msgr2=0x7f909405a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9099415640 1 --2- 10.20.193.40:0/782573896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 0x7f909405a0a0 secure :-1 s=READY pgs=141 gs=3 cs=0 l=1 c_cookie=17404744707916110367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f908400adb0 tx=0x7f908401d890 comp rx=0 tx=0).stop 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9099415640 1 -- 10.20.193.40:0/782573896 shutdown_connections 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9099415640 1 --2- 10.20.193.40:0/782573896 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 0x7f909405a0a0 unknown :-1 s=CLOSED pgs=141 gs=3 cs=0 l=1 c_cookie=17404744707916110367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.002 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9099415640 1 -- 10.20.193.40:0/782573896 >> 10.20.193.40:0/782573896 conn(0x7f90940bb5e0 msgr2=0x7f90940b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 -- 10.20.193.40:0/878480852 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f40b3be0 msgr2=0x7f34f4164dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 --2- 10.20.193.40:0/878480852 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f40b3be0 0x7f34f4164dd0 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=5950600529903994937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34f40b2e90 tx=0x7f34e401c520 comp rx=0 tx=0).stop 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 -- 10.20.193.40:0/878480852 shutdown_connections 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 --2- 10.20.193.40:0/878480852 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f40b3be0 0x7f34f4164dd0 unknown :-1 s=CLOSED pgs=143 gs=1 cs=0 l=1 c_cookie=5950600529903994937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 --2- 10.20.193.40:0/878480852 >> v2:10.20.193.94:3300/0 conn(0x7f34f415b390 0x7f34f4165310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 --2- 10.20.193.40:0/878480852 >> v2:10.20.193.109:3300/0 conn(0x7f34f415afc0 0x7f34f40b36a0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 -- 10.20.193.40:0/878480852 >> 10.20.193.40:0/878480852 conn(0x7f34f4054490 msgr2=0x7f34f4054890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 -- 10.20.193.40:0/878480852 shutdown_connections 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f34f9fc8640 1 -- 10.20.193.40:0/878480852 wait complete. 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 1 -- 10.20.193.40:0/1386064966 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f44e8003ab0 con 0x7f44e0005480 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 1 --2- 10.20.193.40:0/1386064966 >> v2:10.20.193.120:6800/397309233 conn(0x7f44cc0740a0 0x7f44cc094550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 1 -- 10.20.193.40:0/1386064966 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f44e809e880 con 0x7f44e0005480 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 10 client.4527.objecter ms_dispatch2 0x7f44fc000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 3 client.4527.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 3 client.4527.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44f8ff9640 20 client.4527.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c80b0430 con 0x7f84bc0038a0 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f84d6ffd640 1 -- 10.20.193.40:0/1267674317 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84c80b0840 con 0x7f84bc0038a0 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f44fb7fe640 1 --2- 10.20.193.40:0/1386064966 >> v2:10.20.193.120:6800/397309233 conn(0x7f44cc0740a0 0x7f44cc094550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9099415640 1 -- 10.20.193.40:0/782573896 shutdown_connections 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.975+0000 7f9099415640 1 -- 10.20.193.40:0/782573896 wait complete. 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f84de4fe640 1 -- 10.20.193.40:0/1267674317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84bc0038a0 msgr2=0x7f84bc003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f84de4fe640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84bc0038a0 0x7f84bc003d10 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=6599090695033111621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c8002fa0 tx=0x7f84c801f580 comp rx=0 tx=0).stop 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 --2- 10.20.193.40:0/1775059843 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f8416ada0 0x7f6f84166bf0 secure :-1 s=READY pgs=77 gs=2 cs=0 l=1 c_cookie=14448993076237718568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f8405dc70 tx=0x7f6f6c01c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c88522a6173a5428 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81573640 1 -- 10.20.193.40:0/1775059843 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f6c0b0620 con 0x7f6f8416ada0 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1306602640 1 Processor -- start 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81573640 1 -- 10.20.193.40:0/1775059843 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0b07c0 con 0x7f6f8416ada0 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81573640 1 -- 10.20.193.40:0/1775059843 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f6c0b0b90 con 0x7f6f8416ada0 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f44f8ff9640 10 client.4527.objecter ms_handle_connect 0x7f44cc0740a0 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f44fb7fe640 1 --2- 10.20.193.40:0/1386064966 >> v2:10.20.193.120:6800/397309233 conn(0x7f44cc0740a0 0x7f44cc094550 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44fc139c10 tx=0x7f44ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1306602640 1 -- start start 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 librados: starting msgr at 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 librados: starting objecter 2026-02-24T17:25:11.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 Processor -- start 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4932ca7640 1 Processor -- start 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4932ca7640 1 -- start start 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- 10.20.193.40:0/1775059843 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f8416ada0 msgr2=0x7f6f84166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1775059843 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f8416ada0 0x7f6f84166bf0 secure :-1 s=READY pgs=77 gs=2 cs=0 l=1 c_cookie=14448993076237718568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f8405dc70 tx=0x7f6f6c01c5d0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 -- start start 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 librados: setting wanted keys 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 librados: starting msgr at 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 librados: starting objecter 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 librados: calling monclient init 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 Processor -- start 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- 10.20.193.40:0/1775059843 shutdown_connections 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1775059843 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f8416ada0 0x7f6f84166bf0 unknown :-1 s=CLOSED pgs=77 gs=2 cs=0 l=1 c_cookie=14448993076237718568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1775059843 >> v2:10.20.193.109:3300/0 conn(0x7f6f8405d1a0 0x7f6f8405d570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- 10.20.193.40:0/1775059843 >> 10.20.193.40:0/1775059843 conn(0x7f6f840bd200 msgr2=0x7f6f840bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 -- start start 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 librados: setting wanted keys 2026-02-24T17:25:11.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 librados: calling monclient init 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- 10.20.193.40:0/1775059843 shutdown_connections 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- 10.20.193.40:0/1775059843 wait complete. 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1306602640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f130005d1a0 0x7f130005d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 1 -- 10.20.193.40:0/3672176179 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00bc015420 con 0x7f00c816ada0 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1306602640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13001673c0 con 0x7f130016ada0 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4932ca7640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f492c0544f0 0x7f492c0548c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12ff7fe640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f130016ada0 0x7f1300166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45760/0 (socket says 10.20.193.40:45760) 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12ff7fe640 1 -- 10.20.193.40:0/421700566 learned_addr learned my addr 10.20.193.40:0/421700566 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1306602640 1 -- 10.20.193.40:0/421700566 --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13001676a0 con 0x7f13000bc470 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c817edf0 con 0x7f00c816ada0 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00cdb53640 10 client.4533.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c817f3b0 con 0x7f00c816ada0 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00cdb53640 1 librados: init done 2026-02-24T17:25:11.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1306602640 1 -- 10.20.193.40:0/421700566 --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f1300167980 con 0x7f130005d1a0 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f44f8ff9640 1 -- 10.20.193.40:0/1386064966 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f44e80685c0 con 0x7f44e0005480 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4932ca7640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c16b3f0 con 0x7f492c161440 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4932ca7640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c16b6d0 con 0x7f492c057b90 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4932ca7640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f492c16b9b0 con 0x7f492c0544f0 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f493121d640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f492c161440 0x7f492c1618a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45772/0 (socket says 10.20.193.40:45772) 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f493121d640 1 -- 10.20.193.40:0/3984699699 learned_addr learned my addr 10.20.193.40:0/3984699699 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f34f40b3be0 0x7f34f40591c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 0x7f90940b42e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 0x7f9094164500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f34f415afc0 0x7f34f4155e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12fffff640 1 --2- 10.20.193.40:0/421700566 >> v2:10.20.193.94:3300/0 conn(0x7f130005d1a0 0x7f130005d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 0x7f9094164a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90941d2130 con 0x7f9094161a10 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f90941d1fb0 con 0x7f90940b6b60 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f90941d22b0 con 0x7f9094059cd0 2026-02-24T17:25:11.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f415b390 0x7f34f4157430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f34f40b8090 con 0x7f34f415b390 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f34f40b7f10 con 0x7f34f415afc0 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344118291 0 0) 0x7f13001676a0 con 0x7f13000bc470 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f34f40b8210 con 0x7f34f40b3be0 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f2ffd640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f34f415afc0 0x7f34f4155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12e4003620 con 0x7f13000bc470 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f3fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f415b390 0x7f34f4157430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f3fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f415b390 0x7f34f4157430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49122/0 (socket says 10.20.193.40:49122) 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f2ffd640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f34f415afc0 0x7f34f4155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51304/0 (socket says 10.20.193.40:51304) 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f3fff640 1 -- 10.20.193.40:0/1517018217 learned_addr learned my addr 10.20.193.40:0/1517018217 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12fffff640 1 -- 10.20.193.40:0/421700566 >> v2:10.20.193.94:3300/0 conn(0x7f130005d1a0 msgr2=0x7f130005d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12fffff640 1 -- 10.20.193.40:0/421700566 >> v2:10.20.193.94:3300/0 conn(0x7f130005d1a0 msgr2=0x7f130005d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12fffff640 1 --2- 10.20.193.40:0/421700566 >> v2:10.20.193.94:3300/0 conn(0x7f130005d1a0 0x7f130005d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f37fe640 1 --2- 10.20.193.40:0/1517018217 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f34f40b3be0 0x7f34f40591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12fffff640 1 --2- 10.20.193.40:0/421700566 >> v2:10.20.193.94:3300/0 conn(0x7f130005d1a0 0x7f130005d570 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:25:11.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 1 -- 10.20.193.40:0/3672176179 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc01a070 con 0x7f00c816ada0 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 0x7f9094164500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 0x7f9094164500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51290/0 (socket says 10.20.193.40:51290) 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 learned_addr learned my addr 10.20.193.40:0/3257397432 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 <== mon.2 v1:10.20.193.109:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 739148122 0 0) 0x7f12e4003620 con 0x7f13000bc470 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 >> v2:10.20.193.94:3300/0 conn(0x7f130005d1a0 msgr2=0x7f130005d570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 --2- 10.20.193.40:0/421700566 >> v2:10.20.193.94:3300/0 conn(0x7f130005d1a0 0x7f130005d570 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 >> v1:10.20.193.40:6789/0 conn(0x7f130016ada0 legacy=0x7f1300166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 librados: starting msgr at 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 librados: starting objecter 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 --> v1:10.20.193.109:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13000b4430 con 0x7f13000bc470 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 Processor -- start 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 <== mon.2 v1:10.20.193.109:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f12f4004390 con 0x7f13000bc470 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 >> v1:10.20.193.109:6789/0 conn(0x7f13000bc470 legacy=0x7f13000b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f12e4003ba0 0x7f12e4003fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f12e40048d0 0x7f12e4004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f12e40053a0 0x7f12e4065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1300167980 con 0x7f12e40053a0 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f12e406eca0 con 0x7f12e4003ba0 2026-02-24T17:25:11.009 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f12e406eea0 con 0x7f12e40048d0 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0088005130 con 0x7f00c816ada0 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f37fe640 1 -- 10.20.193.40:0/1517018217 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f34f415afc0 msgr2=0x7f34f4155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f37fe640 1 --2- 10.20.193.40:0/1517018217 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f34f415afc0 0x7f34f4155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f37fe640 1 -- 10.20.193.40:0/1517018217 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f415b390 msgr2=0x7f34f4157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f37fe640 1 --2- 10.20.193.40:0/1517018217 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f415b390 0x7f34f4157430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f37fe640 1 -- 10.20.193.40:0/1517018217 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f4059700 con 0x7f34f40b3be0 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1304b78640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f12e40053a0 0x7f12e4065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12ff7fe640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f12e40048d0 0x7f12e4004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 msgr2=0x7f90940b42e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 0x7f90940b42e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 msgr2=0x7f9094164a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 0x7f9094164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9094162e90 con 0x7f90940b6b60 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1304b78640 1 -- 10.20.193.40:0/421700566 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f12e40048d0 msgr2=0x7f12e4004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1304b78640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f12e40048d0 0x7f12e4004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1304b78640 1 -- 10.20.193.40:0/421700566 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f12e4003ba0 msgr2=0x7f12e4003fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1304b78640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f12e4003ba0 0x7f12e4003fb0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f1304b78640 1 -- 10.20.193.40:0/421700566 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e4003620 con 0x7f12e40053a0 2026-02-24T17:25:11.010 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f12ff7fe640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f12e40048d0 0x7f12e4004d40 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- start start 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 librados: setting wanted keys 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 librados: calling monclient init 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f37fe640 1 --2- 10.20.193.40:0/1517018217 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f34f40b3be0 0x7f34f40591c0 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34e000e870 tx=0x7f34e000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34cffff640 10 client.?.objecter ms_handle_connect 0x7f34f40b3be0 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6f8405d1a0 0x7f6f84169590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f840bc470 0x7f6f84126e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6f8416ada0 0x7f6f84127370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8415d9e0 con 0x7f6f8405d1a0 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8415d860 con 0x7f6f840bc470 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f88be1640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f6f841cd510 con 0x7f6f8416ada0 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34cffff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f840bc470 0x7f6f84126e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f840bc470 0x7f6f84126e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:51338/0 (socket says 10.20.193.40:51338) 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 -- 10.20.193.40:0/1663890153 learned_addr learned my addr 10.20.193.40:0/1663890153 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f82d76640 1 --2- 10.20.193.40:0/1663890153 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6f8416ada0 0x7f6f84127370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 0x7f9094164500 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f907c00b4a0 tx=0x7f907c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90737fe640 10 client.?.objecter ms_handle_connect 0x7f90940b6b60 2026-02-24T17:25:11.011 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90737fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34cffff640 1 -- 10.20.193.40:0/1517018217 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34e0017070 con 0x7f34f40b3be0 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34cffff640 1 -- 10.20.193.40:0/1517018217 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e000cb60 con 0x7f34f40b3be0 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34cffff640 1 -- 10.20.193.40:0/1517018217 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34e0004020 con 0x7f34f40b3be0 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 -- 10.20.193.40:0/1517018217 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f4156890 con 0x7f34f40b3be0 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f907c004520 con 0x7f90940b6b60 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 10 client.4514.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90940b2f60 con 0x7f90940b6b60 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 -- 10.20.193.40:0/1517018217 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f40586e0 con 0x7f34f40b3be0 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 10 client.4504.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90940b3520 con 0x7f90940b6b60 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f9099415640 1 librados: init done 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f34f9fc8640 1 librados: init done 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c015070 con 0x7f90940b6b60 2026-02-24T17:25:11.012 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f907c002900 con 0x7f90940b6b60 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 msgr2=0x7f9094164500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 msgr2=0x7f9094164500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 0x7f9094164500 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f907c00b4a0 tx=0x7f907c00b960 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 0x7f9094164500 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f907c00b4a0 tx=0x7f907c00b960 comp rx=0 tx=0).stop 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 -- 10.20.193.40:0/1663890153 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6f8416ada0 msgr2=0x7f6f84127370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 --2- 10.20.193.40:0/1663890153 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6f8416ada0 0x7f6f84127370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 -- 10.20.193.40:0/1663890153 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6f8405d1a0 msgr2=0x7f6f84169590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 --2- 10.20.193.40:0/1663890153 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6f8405d1a0 0x7f6f84169590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f6f81d74640 1 -- 10.20.193.40:0/1663890153 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84127ce0 con 0x7f6f840bc470 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 msgr2=0x7f9094164500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f90737fe640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90940b6b60 0x7f9094164500 unknown :-1 s=CLOSED pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 1 -- 10.20.193.40:0/3672176179 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00bc0157e0 con 0x7f00c816ada0 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 1 -- 10.20.193.40:0/3672176179 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f00bc015980 con 0x7f00c816ada0 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 1 --2- 10.20.193.40:0/3672176179 >> v2:10.20.193.120:6800/397309233 conn(0x7f0098074120 0x7f00980945d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 1 -- 10.20.193.40:0/3672176179 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f00bc098060 con 0x7f00c816ada0 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 10 client.4533.objecter ms_dispatch2 0x7f00c8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 3 client.4533.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 3 client.4533.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f00a3fff640 20 client.4533.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3208236879 0 0) 0x7f492c16b6d0 con 0x7f492c057b90 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4918003620 con 0x7f492c057b90 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4930a1c640 1 --2- 10.20.193.40:0/3984699699 >> v2:10.20.193.109:3300/0 conn(0x7f492c0544f0 0x7f492c0548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066389304 0 0) 0x7f492c16b3f0 con 0x7f492c161440 2026-02-24T17:25:11.013 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c16b6d0 con 0x7f492c161440 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 <== mon.2 v1:10.20.193.109:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1591692925 0 0) 0x7f4918003620 con 0x7f492c057b90 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 >> v2:10.20.193.109:3300/0 conn(0x7f492c0544f0 msgr2=0x7f492c0548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 --2- 10.20.193.40:0/3984699699 >> v2:10.20.193.109:3300/0 conn(0x7f492c0544f0 0x7f492c0548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 >> v1:10.20.193.40:6789/0 conn(0x7f492c161440 legacy=0x7f492c1618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 --> v1:10.20.193.109:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c16bc90 con 0x7f492c057b90 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 <== mon.2 v1:10.20.193.109:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f4914002e80 con 0x7f492c057b90 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 >> v1:10.20.193.109:6789/0 conn(0x7f492c057b90 legacy=0x7f492c057fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4918003dd0 0x7f49180041c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f4918004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f49180053f0 0x7f4918065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f492c16b9b0 con 0x7f4918003dd0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4918066320 con 0x7f49180053f0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f4918066520 con 0x7f49180048d0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4923fff640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f4918004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f493121d640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f49180053f0 0x7f4918065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4923fff640 1 -- 10.20.193.40:0/3984699699 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f49180053f0 msgr2=0x7f4918065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4923fff640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f49180053f0 0x7f4918065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4923fff640 1 -- 10.20.193.40:0/3984699699 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4918003dd0 msgr2=0x7f49180041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4923fff640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f4918003dd0 0x7f49180041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f4923fff640 1 -- 10.20.193.40:0/3984699699 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4918003620 con 0x7f49180048d0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.979+0000 7f493121d640 1 -- 10.20.193.40:0/3984699699 reap_dead start 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f00c77fe640 1 --2- 10.20.193.40:0/3672176179 >> v2:10.20.193.120:6800/397309233 conn(0x7f0098074120 0x7f00980945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f81d74640 1 --2- 10.20.193.40:0/1663890153 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f840bc470 0x7f6f84126e30 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f6c01cb40 tx=0x7f6f6c019370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 10 client.?.objecter ms_handle_connect 0x7f6f840bc470 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cdffb640 1 -- 10.20.193.40:0/1517018217 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b8005130 con 0x7f34f40b3be0 2026-02-24T17:25:11.014 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 0x7f9060023940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 0x7f90600443a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9060044db0 0x7f9060065230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9060065ce0 con 0x7f9094161a10 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9060065e60 con 0x7f9060044db0 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9060065fe0 con 0x7f9094059cd0 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f1304b78640 1 -- 10.20.193.40:0/421700566 reap_dead start 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 1 -- 10.20.193.40:0/1663890153 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f6c0be070 con 0x7f6f840bc470 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f841cb2f0 con 0x7f6f840bc470 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f4923fff640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f4918004d40 secure :-1 s=READY pgs=89 gs=5 cs=0 l=1 c_cookie=33536827376423179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f491400c0e0 tx=0x7f491401cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7725911aaa510b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90937fe640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9060044db0 0x7f9060065230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f1304b78640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f12e40053a0 0x7f12e4065a90 secure :-1 s=READY pgs=148 gs=5 cs=0 l=1 c_cookie=16861715075232099046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12f4004680 tx=0x7f12f401e260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea00d886130eeae6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 0x7f90600443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f88be1640 10 client.4510.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f841684f0 con 0x7f6f840bc470 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f88be1640 1 librados: init done 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 1 -- 10.20.193.40:0/1663890153 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0b07c0 con 0x7f6f840bc470 2026-02-24T17:25:11.015 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 1 -- 10.20.193.40:0/1663890153 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f6c004480 con 0x7f6f840bc470 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9060044db0 msgr2=0x7f9060065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9060044db0 0x7f9060065230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 msgr2=0x7f9060023940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 0x7f9060023940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f9060066310 con 0x7f9094059cd0 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f909405a0a0 con 0x7f9094059cd0 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8405d570 con 0x7f6f840bc470 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90940b3520 con 0x7f9094059cd0 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90927fc640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 0x7f90600443a0 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f907c01a920 tx=0x7f907c009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 10 client.4504.objecter ms_handle_connect 0x7f9094059cd0 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 10 client.4504.objecter resend_mon_ops 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f00a3fff640 10 client.4533.objecter ms_handle_connect 0x7f0098074120 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f00c77fe640 1 --2- 10.20.193.40:0/3672176179 >> v2:10.20.193.120:6800/397309233 conn(0x7f0098074120 0x7f00980945d0 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00b4004700 tx=0x7f00b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cffff640 1 -- 10.20.193.40:0/1517018217 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f34e003cad0 con 0x7f34f40b3be0 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cffff640 1 --2- 10.20.193.40:0/1517018217 >> v2:10.20.193.120:6800/397309233 conn(0x7f34c40786e0 0x7f34c4098b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cffff640 1 -- 10.20.193.40:0/1517018217 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f34e000f040 con 0x7f34f40b3be0 2026-02-24T17:25:11.016 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cffff640 10 client.4514.objecter ms_dispatch2 0x7f34f4000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cffff640 3 client.4514.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cffff640 3 client.4514.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cffff640 20 client.4514.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34f2ffd640 1 --2- 10.20.193.40:0/1517018217 >> v2:10.20.193.120:6800/397309233 conn(0x7f34c40786e0 0x7f34c4098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 1 -- 10.20.193.40:0/1663890153 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f6f6c0e08f0 con 0x7f6f840bc470 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 1 --2- 10.20.193.40:0/1663890153 >> v2:10.20.193.120:6800/397309233 conn(0x7f6f500740f0 0x7f6f500945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 1 -- 10.20.193.40:0/1663890153 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f6f6c0b6070 con 0x7f6f840bc470 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 10 client.4510.objecter ms_dispatch2 0x7f6f84000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 3 client.4510.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 3 client.4510.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 20 client.4510.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f82575640 1 --2- 10.20.193.40:0/1663890153 >> v2:10.20.193.120:6800/397309233 conn(0x7f6f500740f0 0x7f6f500945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34cffff640 10 client.4514.objecter ms_handle_connect 0x7f34c40786e0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f34f2ffd640 1 --2- 10.20.193.40:0/1517018217 >> v2:10.20.193.120:6800/397309233 conn(0x7f34c40786e0 0x7f34c4098b90 secure :-1 s=READY pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34e401a150 tx=0x7f34e40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f00a3fff640 1 -- 10.20.193.40:0/3672176179 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f00bc0624b0 con 0x7f00c816ada0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12f400b3b0 con 0x7f12e40053a0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f40062f0 con 0x7f12e40053a0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f12feffd640 1 -- 10.20.193.40:0/421700566 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12f4006700 con 0x7f12e40053a0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49140b2070 con 0x7f49180048d0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49140a5900 con 0x7f49180048d0 2026-02-24T17:25:11.017 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f49237fe640 1 -- 10.20.193.40:0/3984699699 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4914007c30 con 0x7f49180048d0 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f6affd640 10 client.4510.objecter ms_handle_connect 0x7f6f500740f0 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f6f82575640 1 --2- 10.20.193.40:0/1663890153 >> v2:10.20.193.120:6800/397309233 conn(0x7f6f500740f0 0x7f6f500945a0 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f78004780 tx=0x7f6f78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f907c002df0 con 0x7f9094059cd0 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c0266a0 con 0x7f9094059cd0 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f4932ca7640 1 -- 10.20.193.40:0/3984699699 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 msgr2=0x7f4918004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7f4932ca7640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f4918004d40 secure :-1 s=READY pgs=89 gs=5 cs=0 l=1 c_cookie=33536827376423179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f491400c0e0 tx=0x7f491401cb60 comp rx=0 tx=0).stop 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- 10.20.193.40:0/1267674317 shutdown_connections 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 --2- 10.20.193.40:0/1267674317 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84bc0038a0 0x7f84bc003d10 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=6599090695033111621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- 10.20.193.40:0/1267674317 >> 10.20.193.40:0/1267674317 conn(0x7f84d80b9d40 msgr2=0x7f84d80ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- 10.20.193.40:0/1267674317 shutdown_connections 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- 10.20.193.40:0/1267674317 wait complete. 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- 10.20.193.40:0/421700566 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f12e40053a0 msgr2=0x7f12e4065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f34cffff640 1 -- 10.20.193.40:0/1517018217 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f34e0060210 con 0x7f34f40b3be0 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f12e40053a0 0x7f12e4065a90 secure :-1 s=READY pgs=148 gs=5 cs=0 l=1 c_cookie=16861715075232099046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12f4004680 tx=0x7f12f401e260 comp rx=0 tx=0).stop 2026-02-24T17:25:11.018 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 10 client.4433.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 15 client.4433.objecter _session_command_op_assign -1 2 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 20 client.4433.objecter _get_session s=0x7ff03c099970 osd=7 3 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 20 client.4433.objecter put_session s=0x7ff03c099970 osd=7 3 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 20 client.4433.objecter _get_session s=0x7ff03c099970 osd=7 3 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 15 client.4433.objecter _session_command_op_remove -1 2 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 20 client.4433.objecter get_session s=0x7ff03c099970 osd=7 3 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 15 client.4433.objecter _session_command_op_assign 7 2 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 20 client.4433.objecter put_session s=0x7ff03c099970 osd=7 4 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 10 client.4433.objecter _send_command 2 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 --> v2:10.20.193.120:6813/1724095478 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff06c0b9460 con 0x7ff03c09a020 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff043fff640 1 -- 10.20.193.40:0/2241170175 <== osd.7 v2:10.20.193.120:6813/1724095478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff06c0b9460 con 0x7ff03c09a020 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff043fff640 10 client.4433.objecter ms_dispatch2 0x7ff06c000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff043fff640 10 client.4433.objecter _finish_command 2 = system:0 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff043fff640 20 client.4433.objecter put_session s=0x7ff03c099970 osd=7 4 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff043fff640 15 client.4433.objecter _session_command_op_remove 7 2 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 10 librados: watch_flush enter 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 10 librados: watch_flush exit 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 10 client.4433.objecter close_session for osd.7 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 msgr2=0x7ff03c0ba450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6813/1724095478 conn(0x7ff03c09a020 0x7ff03c0ba450 crc :-1 s=READY pgs=8 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 20 client.4433.objecter put_session s=0x7ff03c099970 osd=7 1 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 20 client.4433.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 10 client.4433.objecter successfully canceled tick 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6800/397309233 conn(0x7ff03c074090 msgr2=0x7ff03c094540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 --2- 10.20.193.40:0/2241170175 >> v2:10.20.193.120:6800/397309233 conn(0x7ff03c074090 0x7ff03c094540 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff05401c8f0 tx=0x7ff0540af040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff0580048d0 msgr2=0x7ff06c1300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 --2- 10.20.193.40:0/2241170175 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff0580048d0 0x7ff06c1300d0 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff060007370 tx=0x7ff060007830 comp rx=0 tx=0).stop 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff06b7fe640 1 -- 10.20.193.40:0/2241170175 reap_dead start 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 shutdown_connections 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 >> 10.20.193.40:0/2241170175 conn(0x7ff06c056f10 msgr2=0x7ff06c135a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 shutdown_connections 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 -- 10.20.193.40:0/2241170175 wait complete. 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.983+0000 7ff0719f9640 1 librados: shutdown 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- 10.20.193.40:0/421700566 shutdown_connections 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 --2- 10.20.193.40:0/421700566 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f12e40053a0 0x7f12e4065a90 unknown :-1 s=CLOSED pgs=148 gs=5 cs=0 l=1 c_cookie=16861715075232099046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- 10.20.193.40:0/421700566 >> 10.20.193.40:0/421700566 conn(0x7f13000bd200 msgr2=0x7f13000bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.019 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- 10.20.193.40:0/421700566 shutdown_connections 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- 10.20.193.40:0/421700566 wait complete. 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 librados: starting msgr at 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 librados: starting objecter 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 Processor -- start 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f907c0233f0 con 0x7f9094059cd0 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- start start 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 librados: setting wanted keys 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 librados: calling monclient init 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 1 --2- 10.20.193.40:0/3257397432 >> v2:10.20.193.120:6800/397309233 conn(0x7f90940b6b60 0x7f90600f6890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.2 v2:10.20.193.109:3300/0 4 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f907c00d040 con 0x7f9094059cd0 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 10 client.4504.objecter ms_dispatch2 0x7f9094000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 3 client.4504.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 3 client.4504.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 librados: starting msgr at 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 librados: starting objecter 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 20 client.4504.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.020 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 Processor -- start 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f9092ffd640 1 --2- 10.20.193.40:0/3257397432 >> v2:10.20.193.120:6800/397309233 conn(0x7f90940b6b60 0x7f90600f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- start start 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 librados: setting wanted keys 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 librados: calling monclient init 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc0038a0 0x7f84d8164030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84d81fbd50 0x7f84d8166dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d805dd50 0x7f84d80b65f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80b2120 con 0x7f84d805dd50 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f84d8168d80 con 0x7f84d81fbd50 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80b22a0 con 0x7f84bc0038a0 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d805dd50 0x7f84d80b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d805dd50 0x7f84d80b65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49182/0 (socket says 10.20.193.40:49182) 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 -- 10.20.193.40:0/2031538544 learned_addr learned my addr 10.20.193.40:0/2031538544 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84d77fe640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84d81fbd50 0x7f84d8166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84d7fff640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc0038a0 0x7f84d8164030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f12e40053a0 0x7f13001440c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f130016a110 0x7f1300142c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13001431a0 0x7f130013b6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f13000ba9c0 con 0x7f13001431a0 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f13000bc8b0 con 0x7f12e40053a0 2026-02-24T17:25:11.021 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1306602640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f13000b49f0 con 0x7f130016a110 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f9092ffd640 1 --2- 10.20.193.40:0/3257397432 >> v2:10.20.193.120:6800/397309233 conn(0x7f90940b6b60 0x7f90600f6890 secure :-1 s=READY pgs=93 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90940b1be0 tx=0x7f9088007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 10 client.4504.objecter ms_handle_connect 0x7f90940b6b60 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 -- 10.20.193.40:0/2031538544 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc0038a0 msgr2=0x7f84d8164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc0038a0 0x7f84d8164030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 -- 10.20.193.40:0/2031538544 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84d81fbd50 msgr2=0x7f84d8166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84d81fbd50 0x7f84d8166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 -- 10.20.193.40:0/2031538544 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d8165d30 con 0x7f84d805dd50 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13001431a0 0x7f130013b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13001431a0 0x7f130013b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49188/0 (socket says 10.20.193.40:49188) 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 -- 10.20.193.40:0/2763065329 learned_addr learned my addr 10.20.193.40:0/2763065329 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84d77fe640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84d81fbd50 0x7f84d8166dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f4932ca7640 1 -- 10.20.193.40:0/3984699699 shutdown_connections 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f4932ca7640 1 --2- 10.20.193.40:0/3984699699 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f4918004d40 unknown :-1 s=CLOSED pgs=89 gs=5 cs=0 l=1 c_cookie=33536827376423179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f4932ca7640 1 -- 10.20.193.40:0/3984699699 >> 10.20.193.40:0/3984699699 conn(0x7f492c0b9d40 msgr2=0x7f492c0ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f4932ca7640 1 -- 10.20.193.40:0/3984699699 shutdown_connections 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f4932ca7640 1 -- 10.20.193.40:0/3984699699 wait complete. 2026-02-24T17:25:11.022 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f12fffff640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f12e40053a0 0x7f13001440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84dca74640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d805dd50 0x7f84d80b65f0 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84cc00faf0 tx=0x7f84cc00fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84d4ff9640 10 client.?.objecter ms_handle_connect 0x7f84d805dd50 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84d4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f12ff7fe640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f130016a110 0x7f1300142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f6f6affd640 1 -- 10.20.193.40:0/1663890153 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f6f6c0ac030 con 0x7f6f840bc470 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 -- 10.20.193.40:0/2763065329 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f130016a110 msgr2=0x7f1300142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f130016a110 0x7f1300142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 -- 10.20.193.40:0/2763065329 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f12e40053a0 msgr2=0x7f13001440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f12e40053a0 0x7f13001440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 -- 10.20.193.40:0/2763065329 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130016a560 con 0x7f13001431a0 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84d4ff9640 1 -- 10.20.193.40:0/2031538544 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84cc011730 con 0x7f84d805dd50 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84d4ff9640 1 -- 10.20.193.40:0/2031538544 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc0118f0 con 0x7f84d805dd50 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d8166010 con 0x7f84d805dd50 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84d4ff9640 1 -- 10.20.193.40:0/2031538544 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84cc011d00 con 0x7f84d805dd50 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 10 client.4545.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d81665d0 con 0x7f84d805dd50 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 librados: init done 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f12fcff9640 10 client.?.objecter ms_handle_connect 0x7f13001431a0 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f12fcff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:11.023 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f1304b78640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13001431a0 0x7f130013b6d0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12f40045b0 tx=0x7f12f401b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.2 v2:10.20.193.109:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f907c061ec0 con 0x7f9094059cd0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f4932ca7640 1 librados: starting msgr at 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f4932ca7640 1 librados: starting objecter 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d80578d0 con 0x7f84d805dd50 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.987+0000 7f4932ca7640 1 Processor -- start 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 -- start start 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 librados: setting wanted keys 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 librados: calling monclient init 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 1 -- 10.20.193.40:0/2031538544 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f84cc015430 con 0x7f84d805dd50 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f12fcff9640 1 -- 10.20.193.40:0/2763065329 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12f40064a0 con 0x7f13001431a0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1300143610 con 0x7f13001431a0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f492c078e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f492c1208c0 0x7f492c11f920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f492c0773c0 0x7f492c160200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f492c16e5f0 con 0x7f492c1208c0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f492c058580 con 0x7f492c0773c0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f492c16e770 con 0x7f49180048d0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f492c1208c0 0x7f492c11f920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f492c1208c0 0x7f492c11f920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49192/0 (socket says 10.20.193.40:49192) 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4930a1c640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f492c078e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.024 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 -- 10.20.193.40:0/3535898307 learned_addr learned my addr 10.20.193.40:0/3535898307 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f493121d640 1 --2- 10.20.193.40:0/3535898307 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f492c0773c0 0x7f492c160200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f1306602640 10 client.4548.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1300169630 con 0x7f13001431a0 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f1306602640 1 librados: init done 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 1 --2- 10.20.193.40:0/2031538544 >> v2:10.20.193.120:6800/397309233 conn(0x7f84a8074070 0x7f84a8094520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 1 -- 10.20.193.40:0/2031538544 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f84cc011040 con 0x7f84d805dd50 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 10 client.4545.objecter ms_dispatch2 0x7f84d8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 3 client.4545.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 3 client.4545.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 20 client.4545.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d7fff640 1 --2- 10.20.193.40:0/2031538544 >> v2:10.20.193.120:6800/397309233 conn(0x7f84a8074070 0x7f84a8094520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 -- 10.20.193.40:0/3535898307 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 msgr2=0x7f492c078e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 --2- 10.20.193.40:0/3535898307 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f492c078e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 -- 10.20.193.40:0/3535898307 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f492c0773c0 msgr2=0x7f492c160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 --2- 10.20.193.40:0/3535898307 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f492c0773c0 0x7f492c160200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 -- 10.20.193.40:0/3535898307 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c123260 con 0x7f492c1208c0 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1300169400 con 0x7f13001431a0 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4923fff640 1 --2- 10.20.193.40:0/3535898307 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f492c1208c0 0x7f492c11f920 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f491401b260 tx=0x7f4918005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f49217fa640 10 client.?.objecter ms_handle_connect 0x7f492c1208c0 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f49217fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:11.025 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f907c067740 con 0x7f9094059cd0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d7fff640 1 --2- 10.20.193.40:0/2031538544 >> v2:10.20.193.120:6800/397309233 conn(0x7f84a8074070 0x7f84a8094520 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c4002920 tx=0x7f84c40035e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 10 client.4545.objecter ms_handle_connect 0x7f84a8074070 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f12fcff9640 1 -- 10.20.193.40:0/2763065329 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f4006190 con 0x7f13001431a0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f12fcff9640 1 -- 10.20.193.40:0/2763065329 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12f4006860 con 0x7f13001431a0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f49217fa640 1 -- 10.20.193.40:0/3535898307 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49140b2040 con 0x7f492c1208c0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c11eb60 con 0x7f492c1208c0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 10 client.4551.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c11f120 con 0x7f492c1208c0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f4932ca7640 1 librados: init done 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.991+0000 7f84d4ff9640 1 -- 10.20.193.40:0/2031538544 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f84cc060580 con 0x7f84d805dd50 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c16eb00 con 0x7f492c1208c0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f49217fa640 1 -- 10.20.193.40:0/3535898307 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49140050e0 con 0x7f492c1208c0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fcff9640 1 -- 10.20.193.40:0/2763065329 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f12f40b8430 con 0x7f13001431a0 2026-02-24T17:25:11.026 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fcff9640 1 --2- 10.20.193.40:0/2763065329 >> v2:10.20.193.120:6800/397309233 conn(0x7f12d00740f0 0x7f12d00945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f49217fa640 1 -- 10.20.193.40:0/3535898307 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49140054d0 con 0x7f492c1208c0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fcff9640 1 -- 10.20.193.40:0/2763065329 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f12f412f3a0 con 0x7f13001431a0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fcff9640 10 client.4548.objecter ms_dispatch2 0x7f1300000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fcff9640 3 client.4548.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fcff9640 3 client.4548.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fffff640 1 --2- 10.20.193.40:0/2763065329 >> v2:10.20.193.120:6800/397309233 conn(0x7f12d00740f0 0x7f12d00945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fcff9640 20 client.4548.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fcff9640 10 client.4548.objecter ms_handle_connect 0x7f12d00740f0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f12fffff640 1 --2- 10.20.193.40:0/2763065329 >> v2:10.20.193.120:6800/397309233 conn(0x7f12d00740f0 0x7f12d00945a0 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12ec004780 tx=0x7f12ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f49217fa640 1 -- 10.20.193.40:0/3535898307 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f49140b5070 con 0x7f492c1208c0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f49217fa640 1 --2- 10.20.193.40:0/3535898307 >> v2:10.20.193.120:6800/397309233 conn(0x7f48fc074080 0x7f48fc094530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.995+0000 7f4930a1c640 1 --2- 10.20.193.40:0/3535898307 >> v2:10.20.193.120:6800/397309233 conn(0x7f48fc074080 0x7f48fc094530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.999+0000 7f49217fa640 10 client.4551.objecter ms_handle_connect 0x7f48fc074080 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.999+0000 7f4930a1c640 1 --2- 10.20.193.40:0/3535898307 >> v2:10.20.193.120:6800/397309233 conn(0x7f48fc074080 0x7f48fc094530 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f492c16f660 tx=0x7f491c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.999+0000 7f49217fa640 1 -- 10.20.193.40:0/3535898307 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f491412db40 con 0x7f492c1208c0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.999+0000 7f49217fa640 10 client.4551.objecter ms_dispatch2 0x7f492c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.999+0000 7f49217fa640 3 client.4551.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.999+0000 7f49217fa640 3 client.4551.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.999+0000 7f12fcff9640 1 -- 10.20.193.40:0/2763065329 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f12f40bd020 con 0x7f13001431a0 2026-02-24T17:25:11.027 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:10.999+0000 7f49217fa640 20 client.4551.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.028 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:11.028 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-24T17:25:11.028 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.003+0000 7f49217fa640 1 -- 10.20.193.40:0/3535898307 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f4914016910 con 0x7f492c1208c0 2026-02-24T17:25:11.080 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.071+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb4ec0b52d0 con 0x7fb4ec1671e0 2026-02-24T17:25:11.081 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.071+0000 7fb4e8ff9640 1 -- 10.20.193.40:0/4033743813 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4e0066650 con 0x7fb4ec1671e0 2026-02-24T17:25:11.081 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 10 librados: watch_flush enter 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 10 librados: watch_flush exit 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 20 client.4518.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 10 client.4518.objecter successfully canceled tick 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 >> v2:10.20.193.120:6800/397309233 conn(0x7fb4bc0740f0 msgr2=0x7fb4bc0945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 --2- 10.20.193.40:0/4033743813 >> v2:10.20.193.120:6800/397309233 conn(0x7fb4bc0740f0 0x7fb4bc0945a0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d801c450 tx=0x7fb4d8008040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4ec1671e0 msgr2=0x7fb4ec11fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4ec1671e0 0x7fb4ec11fc40 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4e000c9b0 tx=0x7fb4e000ce70 comp rx=0 tx=0).stop 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 shutdown_connections 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 --2- 10.20.193.40:0/4033743813 >> v2:10.20.193.120:6800/397309233 conn(0x7fb4bc0740f0 0x7fb4bc0945a0 unknown :-1 s=CLOSED pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb4ec1671e0 0x7fb4ec11fc40 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb4ec15d880 0x7fb4ec059a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 --2- 10.20.193.40:0/4033743813 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb4ec15d4b0 0x7fb4ec162970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 >> 10.20.193.40:0/4033743813 conn(0x7fb4ec0bb2a0 msgr2=0x7fb4ec0bb670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 shutdown_connections 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 -- 10.20.193.40:0/4033743813 wait complete. 2026-02-24T17:25:11.083 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7fb4f27b3640 1 librados: shutdown 2026-02-24T17:25:11.086 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8d34166b40 con 0x7f8d3415d560 2026-02-24T17:25:11.087 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.075+0000 7f8d1affd640 1 -- 10.20.193.40:0/2073207847 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d24061160 con 0x7f8d3415d560 2026-02-24T17:25:11.087 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:11.088 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7fed900bd950 con 0x7fed9005d1a0 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 10 librados: watch_flush enter 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 10 librados: watch_flush exit 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 20 client.4521.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 10 client.4521.objecter successfully canceled tick 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 >> v2:10.20.193.120:6800/397309233 conn(0x7f8d000740f0 msgr2=0x7f8d000945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 --2- 10.20.193.40:0/2073207847 >> v2:10.20.193.120:6800/397309233 conn(0x7f8d000740f0 0x7f8d000945a0 secure :-1 s=READY pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d280047a0 tx=0x7f8d28009190 comp rx=0 tx=0).stop 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3415d560 msgr2=0x7f8d341613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3415d560 0x7f8d341613c0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2400d8f0 tx=0x7f8d2400ddb0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 shutdown_connections 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 --2- 10.20.193.40:0/2073207847 >> v2:10.20.193.120:6800/397309233 conn(0x7f8d000740f0 0x7f8d000945a0 unknown :-1 s=CLOSED pgs=88 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8d3415d560 0x7f8d341613c0 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8d340b5cd0 0x7f8d34129150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 --2- 10.20.193.40:0/2073207847 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8d3405d9b0 0x7f8d34161e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 >> 10.20.193.40:0/2073207847 conn(0x7f8d340b8a00 msgr2=0x7f8d340b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7fed8cff9640 1 -- 10.20.193.40:0/4080771846 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fed7c0659f0 con 0x7fed9005d1a0 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 shutdown_connections 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 -- 10.20.193.40:0/2073207847 wait complete. 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:11.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.079+0000 7f8d38c82640 1 librados: shutdown 2026-02-24T17:25:11.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 10 librados: watch_flush enter 2026-02-24T17:25:11.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 10 librados: watch_flush exit 2026-02-24T17:25:11.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 20 client.4515.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 10 client.4515.objecter successfully canceled tick 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 >> v2:10.20.193.120:6800/397309233 conn(0x7fed600741d0 msgr2=0x7fed60094680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 --2- 10.20.193.40:0/4080771846 >> v2:10.20.193.120:6800/397309233 conn(0x7fed600741d0 0x7fed60094680 secure :-1 s=READY pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed80009690 tx=0x7fed800a7000 comp rx=0 tx=0).stop 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9005d1a0 msgr2=0x7fed90179d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 --2- 10.20.193.40:0/4080771846 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9005d1a0 0x7fed90179d30 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed7c009460 tx=0x7fed7c00ec60 comp rx=0 tx=0).stop 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 shutdown_connections 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 --2- 10.20.193.40:0/4080771846 >> v2:10.20.193.120:6800/397309233 conn(0x7fed600741d0 0x7fed60094680 unknown :-1 s=CLOSED pgs=86 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 --2- 10.20.193.40:0/4080771846 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fed9016ada0 0x7fed9013aaa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 --2- 10.20.193.40:0/4080771846 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fed900bc470 0x7fed9017a270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 --2- 10.20.193.40:0/4080771846 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fed9005d1a0 0x7fed90179d30 unknown :-1 s=CLOSED pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 >> 10.20.193.40:0/4080771846 conn(0x7fed900bd200 msgr2=0x7fed9013b890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 shutdown_connections 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 -- 10.20.193.40:0/4080771846 wait complete. 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7fed96886640 1 librados: shutdown 2026-02-24T17:25:11.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f44fc134220 con 0x7f44e0005480 2026-02-24T17:25:11.093 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.083+0000 7f44f8ff9640 1 -- 10.20.193.40:0/1386064966 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f44e806df70 con 0x7f44e0005480 2026-02-24T17:25:11.093 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.4 2026-02-24T17:25:11.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 10 librados: watch_flush enter 2026-02-24T17:25:11.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 10 librados: watch_flush exit 2026-02-24T17:25:11.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 20 client.4527.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 10 client.4527.objecter successfully canceled tick 2026-02-24T17:25:11.096 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 >> v2:10.20.193.120:6800/397309233 conn(0x7f44cc0740a0 msgr2=0x7f44cc094550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 --2- 10.20.193.40:0/1386064966 >> v2:10.20.193.120:6800/397309233 conn(0x7f44cc0740a0 0x7f44cc094550 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44fc139c10 tx=0x7f44ec009040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e0005480 msgr2=0x7f44fc1392a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e0005480 0x7f44fc1392a0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e8003210 tx=0x7f44e8006300 comp rx=0 tx=0).stop 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 shutdown_connections 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 --2- 10.20.193.40:0/1386064966 >> v2:10.20.193.120:6800/397309233 conn(0x7f44cc0740a0 0x7f44cc094550 unknown :-1 s=CLOSED pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f44fc14b2a0 0x7f44fc166220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f44fc1397e0 0x7f44fc165ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 --2- 10.20.193.40:0/1386064966 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f44e0005480 0x7f44fc1392a0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 >> 10.20.193.40:0/1386064966 conn(0x7f44fc0bd200 msgr2=0x7f44fc0bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 shutdown_connections 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 -- 10.20.193.40:0/1386064966 wait complete. 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f45026af640 1 librados: shutdown 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f0088005420 con 0x7f00c816ada0 2026-02-24T17:25:11.097 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7f00a3fff640 1 -- 10.20.193.40:0/3672176179 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f00bc061d90 con 0x7f00c816ada0 2026-02-24T17:25:11.098 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fdc6c17a640 con 0x7fdc6c16ada0 2026-02-24T17:25:11.098 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.087+0000 7fdc4b7fe640 1 -- 10.20.193.40:0/1155938497 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc5c017580 con 0x7fdc6c16ada0 2026-02-24T17:25:11.098 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 10 librados: watch_flush enter 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 10 librados: watch_flush exit 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 20 client.4533.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 10 client.4533.objecter successfully canceled tick 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 >> v2:10.20.193.120:6800/397309233 conn(0x7f0098074120 msgr2=0x7f00980945d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 --2- 10.20.193.40:0/3672176179 >> v2:10.20.193.120:6800/397309233 conn(0x7f0098074120 0x7f00980945d0 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00b4004700 tx=0x7f00b4008040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00c816ada0 msgr2=0x7f00c80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00c816ada0 0x7f00c80b78b0 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00bc00a4c0 tx=0x7f00bc00f4b0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 shutdown_connections 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 --2- 10.20.193.40:0/3672176179 >> v2:10.20.193.120:6800/397309233 conn(0x7f0098074120 0x7f00980945d0 unknown :-1 s=CLOSED pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f00c816ada0 0x7f00c80b78b0 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f00c80bc470 0x7f00c8163ca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 --2- 10.20.193.40:0/3672176179 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f00c805d1a0 0x7f00c8180170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 >> 10.20.193.40:0/3672176179 conn(0x7f00c80bd200 msgr2=0x7f00c815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 shutdown_connections 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 -- 10.20.193.40:0/3672176179 wait complete. 2026-02-24T17:25:11.100 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7f00cdb53640 1 librados: shutdown 2026-02-24T17:25:11.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313219 for osd.0 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 10 librados: watch_flush enter 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 10 librados: watch_flush exit 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 10 client.4462.objecter successfully canceled tick 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 >> v2:10.20.193.120:6800/397309233 conn(0x7fdc38074070 msgr2=0x7fdc38094520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 --2- 10.20.193.40:0/1155938497 >> v2:10.20.193.120:6800/397309233 conn(0x7fdc38074070 0x7fdc38094520 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc60004740 tx=0x7fdc60008040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fdc6c16ada0 msgr2=0x7fdc6c17a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 --2- 10.20.193.40:0/1155938497 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fdc6c16ada0 0x7fdc6c17a950 secure :-1 s=READY pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc5c01e200 tx=0x7fdc5c01a700 comp rx=0 tx=0).stop 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 shutdown_connections 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 --2- 10.20.193.40:0/1155938497 >> v2:10.20.193.120:6800/397309233 conn(0x7fdc38074070 0x7fdc38094520 unknown :-1 s=CLOSED pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 --2- 10.20.193.40:0/1155938497 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fdc6c16ada0 0x7fdc6c17a950 unknown :-1 s=CLOSED pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 --2- 10.20.193.40:0/1155938497 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fdc6c0bc470 0x7fdc6c165d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 --2- 10.20.193.40:0/1155938497 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fdc6c05d1a0 0x7fdc6c179a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 >> 10.20.193.40:0/1155938497 conn(0x7fdc6c0bd200 msgr2=0x7fdc6c0bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 shutdown_connections 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 -- 10.20.193.40:0/1155938497 wait complete. 2026-02-24T17:25:11.102 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.091+0000 7fdc71151640 1 librados: shutdown 2026-02-24T17:25:11.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.12 2026-02-24T17:25:11.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.15 2026-02-24T17:25:11.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.11 2026-02-24T17:25:11.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.9 2026-02-24T17:25:11.122 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.111+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6f840bbb30 con 0x7f6f840bc470 2026-02-24T17:25:11.122 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.111+0000 7f6f6affd640 1 -- 10.20.193.40:0/1663890153 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f6c0161f0 con 0x7f6f840bc470 2026-02-24T17:25:11.123 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f84d8158ec0 con 0x7f84d805dd50 2026-02-24T17:25:11.124 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84d4ff9640 1 -- 10.20.193.40:0/2031538544 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f84cc065f10 con 0x7f84d805dd50 2026-02-24T17:25:11.124 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 10 librados: watch_flush enter 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 10 librados: watch_flush exit 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 20 client.4510.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 10 client.4510.objecter successfully canceled tick 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 >> v2:10.20.193.120:6800/397309233 conn(0x7f6f500740f0 msgr2=0x7f6f500945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1663890153 >> v2:10.20.193.120:6800/397309233 conn(0x7f6f500740f0 0x7f6f500945a0 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f78004780 tx=0x7f6f78008040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f840bc470 msgr2=0x7f6f84126e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1663890153 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f840bc470 0x7f6f84126e30 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f6c01cb40 tx=0x7f6f6c019370 comp rx=0 tx=0).stop 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 shutdown_connections 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1663890153 >> v2:10.20.193.120:6800/397309233 conn(0x7f6f500740f0 0x7f6f500945a0 unknown :-1 s=CLOSED pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1663890153 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6f8416ada0 0x7f6f84127370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1663890153 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6f840bc470 0x7f6f84126e30 unknown :-1 s=CLOSED pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 --2- 10.20.193.40:0/1663890153 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6f8405d1a0 0x7f6f84169590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 >> 10.20.193.40:0/1663890153 conn(0x7f6f840bd200 msgr2=0x7f6f8413b320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 shutdown_connections 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 -- 10.20.193.40:0/1663890153 wait complete. 2026-02-24T17:25:11.125 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f6f88be1640 1 librados: shutdown 2026-02-24T17:25:11.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 10 librados: watch_flush enter 2026-02-24T17:25:11.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 10 librados: watch_flush exit 2026-02-24T17:25:11.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 20 client.4545.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.126 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 10 client.4545.objecter successfully canceled tick 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 >> v2:10.20.193.120:6800/397309233 conn(0x7f84a8074070 msgr2=0x7f84a8094520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 --2- 10.20.193.40:0/2031538544 >> v2:10.20.193.120:6800/397309233 conn(0x7f84a8074070 0x7f84a8094520 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c4002920 tx=0x7f84c40035e0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d805dd50 msgr2=0x7f84d80b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d805dd50 0x7f84d80b65f0 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84cc00faf0 tx=0x7f84cc00fbe0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 shutdown_connections 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 --2- 10.20.193.40:0/2031538544 >> v2:10.20.193.120:6800/397309233 conn(0x7f84a8074070 0x7f84a8094520 unknown :-1 s=CLOSED pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f84d805dd50 0x7f84d80b65f0 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f84d81fbd50 0x7f84d8166dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 --2- 10.20.193.40:0/2031538544 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f84bc0038a0 0x7f84d8164030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 >> 10.20.193.40:0/2031538544 conn(0x7f84d80b9d40 msgr2=0x7f84d8155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 shutdown_connections 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 -- 10.20.193.40:0/2031538544 wait complete. 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.115+0000 7f84de4fe640 1 librados: shutdown 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f1300167590 con 0x7f13001431a0 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f12fcff9640 1 -- 10.20.193.40:0/2763065329 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f12f4018010 con 0x7f13001431a0 2026-02-24T17:25:11.127 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.128 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7ff30c1795c0 con 0x7ff30c0b4860 2026-02-24T17:25:11.128 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff2e7fff640 1 -- 10.20.193.40:0/2914364649 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2fc060a80 con 0x7ff30c0b4860 2026-02-24T17:25:11.128 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 10 librados: watch_flush enter 2026-02-24T17:25:11.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 10 librados: watch_flush exit 2026-02-24T17:25:11.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 20 client.4548.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.129 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 10 client.4548.objecter successfully canceled tick 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 >> v2:10.20.193.120:6800/397309233 conn(0x7f12d00740f0 msgr2=0x7f12d00945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 --2- 10.20.193.40:0/2763065329 >> v2:10.20.193.120:6800/397309233 conn(0x7f12d00740f0 0x7f12d00945a0 secure :-1 s=READY pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12ec004780 tx=0x7f12ec008040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13001431a0 msgr2=0x7f130013b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13001431a0 0x7f130013b6d0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12f40045b0 tx=0x7f12f401b0a0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 shutdown_connections 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 --2- 10.20.193.40:0/2763065329 >> v2:10.20.193.120:6800/397309233 conn(0x7f12d00740f0 0x7f12d00945a0 unknown :-1 s=CLOSED pgs=95 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f13001431a0 0x7f130013b6d0 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f130016a110 0x7f1300142c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 --2- 10.20.193.40:0/2763065329 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f12e40053a0 0x7f13001440c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 >> 10.20.193.40:0/2763065329 conn(0x7f13000bd200 msgr2=0x7f1300135cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 shutdown_connections 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 -- 10.20.193.40:0/2763065329 wait complete. 2026-02-24T17:25:11.130 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7f1306602640 1 librados: shutdown 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 10 librados: watch_flush enter 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 10 librados: watch_flush exit 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 20 client.4506.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 10 client.4506.objecter successfully canceled tick 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 >> v2:10.20.193.120:6800/397309233 conn(0x7ff2dc074240 msgr2=0x7ff2dc0946f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 --2- 10.20.193.40:0/2914364649 >> v2:10.20.193.120:6800/397309233 conn(0x7ff2dc074240 0x7ff2dc0946f0 secure :-1 s=READY pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f801d850 tx=0x7ff2f80a8070 comp rx=0 tx=0).stop 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff30c0b4860 msgr2=0x7ff30c165860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff30c0b4860 0x7ff30c165860 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2fc00e980 tx=0x7ff2fc00ee40 comp rx=0 tx=0).stop 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 shutdown_connections 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 --2- 10.20.193.40:0/2914364649 >> v2:10.20.193.120:6800/397309233 conn(0x7ff2dc074240 0x7ff2dc0946f0 unknown :-1 s=CLOSED pgs=83 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff30c15cba0 0x7ff30c17a960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff30c0b4860 0x7ff30c165860 unknown :-1 s=CLOSED pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 --2- 10.20.193.40:0/2914364649 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff30c0566e0 0x7ff30c179080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.119+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 >> 10.20.193.40:0/2914364649 conn(0x7ff30c05d030 msgr2=0x7ff30c0bd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.123+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 shutdown_connections 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.123+0000 7ff31205e640 1 -- 10.20.193.40:0/2914364649 wait complete. 2026-02-24T17:25:11.131 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.123+0000 7ff31205e640 1 librados: shutdown 2026-02-24T17:25:11.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.6 2026-02-24T17:25:11.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.14 2026-02-24T17:25:11.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.10 2026-02-24T17:25:11.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.131+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f268c158800 con 0x7f268c059cb0 2026-02-24T17:25:11.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2663fff640 1 -- 10.20.193.40:0/2571545121 <== mon.2 v2:10.20.193.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f26800aae20 con 0x7f268c059cb0 2026-02-24T17:25:11.143 INFO:teuthology.orchestra.run.trial040.stdout:90194313219 2026-02-24T17:25:11.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.8 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 10 librados: watch_flush enter 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 10 librados: watch_flush exit 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 20 client.4478.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 10 client.4478.objecter successfully canceled tick 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 >> v2:10.20.193.120:6800/397309233 conn(0x7f265c0741d0 msgr2=0x7f265c094680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 --2- 10.20.193.40:0/2571545121 >> v2:10.20.193.120:6800/397309233 conn(0x7f265c0741d0 0x7f265c094680 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f268c167930 tx=0x7f2674009040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 msgr2=0x7f268c162ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 --2- 10.20.193.40:0/2571545121 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c162ba0 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2680004780 tx=0x7f268001ad60 comp rx=0 tx=0).stop 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 shutdown_connections 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 --2- 10.20.193.40:0/2571545121 >> v2:10.20.193.120:6800/397309233 conn(0x7f265c0741d0 0x7f265c094680 unknown :-1 s=CLOSED pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 --2- 10.20.193.40:0/2571545121 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f268c15c8e0 0x7f268c17ab40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 --2- 10.20.193.40:0/2571545121 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f268c0b63c0 0x7f268c17d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 --2- 10.20.193.40:0/2571545121 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f268c059cb0 0x7f268c162ba0 unknown :-1 s=CLOSED pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 >> 10.20.193.40:0/2571545121 conn(0x7f268c0bb5e0 msgr2=0x7f268c057d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 shutdown_connections 2026-02-24T17:25:11.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 -- 10.20.193.40:0/2571545121 wait complete. 2026-02-24T17:25:11.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.135+0000 7f2691886640 1 librados: shutdown 2026-02-24T17:25:11.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 Processor -- start 2026-02-24T17:25:11.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- start start 2026-02-24T17:25:11.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f94f415ae60 0x7f94f40b4690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f40b35f0 con 0x7f94f405b890 2026-02-24T17:25:11.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f40b38d0 con 0x7f94f4165310 2026-02-24T17:25:11.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f94f40b4200 con 0x7f94f415ae60 2026-02-24T17:25:11.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f3fff640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f94f415ae60 0x7f94f40b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f894f640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f94f405b890 0x7f94f40b8c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:45782/0 (socket says 10.20.193.40:45782) 2026-02-24T17:25:11.148 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f894f640 1 -- 10.20.193.40:0/437914865 learned_addr learned my addr 10.20.193.40:0/437914865 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:11.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f2ffd640 1 -- 10.20.193.40:0/437914865 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675906742 0 0) 0x7f94f40b35f0 con 0x7f94f405b890 2026-02-24T17:25:11.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f2ffd640 1 -- 10.20.193.40:0/437914865 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94d8003620 con 0x7f94f405b890 2026-02-24T17:25:11.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f3fff640 1 -- 10.20.193.40:0/437914865 >> v1:10.20.193.109:6789/0 conn(0x7f94f4165310 legacy=0x7f94f405b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f3fff640 1 -- 10.20.193.40:0/437914865 >> v1:10.20.193.40:6789/0 conn(0x7f94f405b890 legacy=0x7f94f40b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f3fff640 1 -- 10.20.193.40:0/437914865 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f40b3bb0 con 0x7f94f415ae60 2026-02-24T17:25:11.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f3fff640 1 --2- 10.20.193.40:0/437914865 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f40b4690 secure :-1 s=READY pgs=153 gs=3 cs=0 l=1 c_cookie=8538745374790820466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e0004780 tx=0x7f94e001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767fb7ad9beaa272 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f2ffd640 1 -- 10.20.193.40:0/437914865 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94e00b5070 con 0x7f94f415ae60 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f2ffd640 1 -- 10.20.193.40:0/437914865 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e00a8a70 con 0x7f94f415ae60 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94f2ffd640 1 -- 10.20.193.40:0/437914865 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94e00a8e60 con 0x7f94f415ae60 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f789415ae30 con 0x7f789416ada0 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- 10.20.193.40:0/437914865 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 msgr2=0x7f94f40b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 --2- 10.20.193.40:0/437914865 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f40b4690 secure :-1 s=READY pgs=153 gs=3 cs=0 l=1 c_cookie=8538745374790820466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e0004780 tx=0x7f94e001ed50 comp rx=0 tx=0).stop 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- 10.20.193.40:0/437914865 shutdown_connections 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 --2- 10.20.193.40:0/437914865 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f40b4690 unknown :-1 s=CLOSED pgs=153 gs=3 cs=0 l=1 c_cookie=8538745374790820466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- 10.20.193.40:0/437914865 >> 10.20.193.40:0/437914865 conn(0x7f94f40bb380 msgr2=0x7f94f40bb780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- 10.20.193.40:0/437914865 shutdown_connections 2026-02-24T17:25:11.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f7890ff9640 1 -- 10.20.193.40:0/756714917 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7888067270 con 0x7f789416ada0 2026-02-24T17:25:11.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 -- 10.20.193.40:0/437914865 wait complete. 2026-02-24T17:25:11.151 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 librados: starting msgr at 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 librados: starting objecter 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.139+0000 7f94fa3d9640 1 Processor -- start 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 -- start start 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 librados: setting wanted keys 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 librados: calling monclient init 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94f405b890 0x7f94f4154600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f4161530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94f4165310 0x7f94f4168050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f94f4058640 con 0x7f94f415ae60 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f94f40b32a0 con 0x7f94f4165310 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f94f40b4bd0 con 0x7f94f405b890 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f4161530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f4161530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:49210/0 (socket says 10.20.193.40:49210) 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 -- 10.20.193.40:0/2471987409 learned_addr learned my addr 10.20.193.40:0/2471987409 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f894f640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94f4165310 0x7f94f4168050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f3fff640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94f405b890 0x7f94f4154600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 -- 10.20.193.40:0/2471987409 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94f405b890 msgr2=0x7f94f4154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94f405b890 0x7f94f4154600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 -- 10.20.193.40:0/2471987409 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94f4165310 msgr2=0x7f94f4168050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94f4165310 0x7f94f4168050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 -- 10.20.193.40:0/2471987409 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f41fdcd0 con 0x7f94f415ae60 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f3fff640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94f405b890 0x7f94f4154600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f37fe640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f4161530 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e400c4f0 tx=0x7f94e400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 10 client.?.objecter ms_handle_connect 0x7f94f415ae60 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 1 -- 10.20.193.40:0/2471987409 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94e4016020 con 0x7f94f415ae60 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 1 -- 10.20.193.40:0/2471987409 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e4005240 con 0x7f94f415ae60 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f4160490 con 0x7f94f415ae60 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 1 -- 10.20.193.40:0/2471987409 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94e40068d0 con 0x7f94f415ae60 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 10 client.4560.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f4160a50 con 0x7f94f415ae60 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 librados: init done 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 10 librados: watch_flush enter 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 10 librados: watch_flush exit 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 20 client.4509.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 10 client.4509.objecter successfully canceled tick 2026-02-24T17:25:11.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 >> v2:10.20.193.120:6800/397309233 conn(0x7f78640741d0 msgr2=0x7f7864094680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 --2- 10.20.193.40:0/756714917 >> v2:10.20.193.120:6800/397309233 conn(0x7f78640741d0 0x7f7864094680 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 msgr2=0x7f789417f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f789417f2a0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f788800d920 tx=0x7f788800dde0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f40b35f0 con 0x7f94f415ae60 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 shutdown_connections 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 --2- 10.20.193.40:0/756714917 >> v2:10.20.193.120:6800/397309233 conn(0x7f78640741d0 0x7f7864094680 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f789416ada0 0x7f789417f2a0 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f78940bc470 0x7f789413f440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 --2- 10.20.193.40:0/756714917 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f789405d1a0 0x7f789413ef00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 >> 10.20.193.40:0/756714917 conn(0x7f78940bd200 msgr2=0x7f78940b8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 shutdown_connections 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 -- 10.20.193.40:0/756714917 wait complete. 2026-02-24T17:25:11.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f789a943640 1 librados: shutdown 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 1 -- 10.20.193.40:0/2471987409 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f94e4023070 con 0x7f94f415ae60 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 1 --2- 10.20.193.40:0/2471987409 >> v2:10.20.193.120:6800/397309233 conn(0x7f94c4074100 0x7f94c40945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 1 -- 10.20.193.40:0/2471987409 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f94e4096330 con 0x7f94f415ae60 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 10 client.4560.objecter ms_dispatch2 0x7f94f4000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 3 client.4560.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 3 client.4560.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 20 client.4560.objecter dump_active .. 0 homeless 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f3fff640 1 --2- 10.20.193.40:0/2471987409 >> v2:10.20.193.120:6800/397309233 conn(0x7f94c4074100 0x7f94c40945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 10 client.4560.objecter ms_handle_connect 0x7f94c4074100 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f3fff640 1 --2- 10.20.193.40:0/2471987409 >> v2:10.20.193.120:6800/397309233 conn(0x7f94c4074100 0x7f94c40945b0 secure :-1 s=READY pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e00095c0 tx=0x7f94e00aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.143+0000 7f94f0ff9640 1 -- 10.20.193.40:0/2471987409 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f94e4020020 con 0x7f94f415ae60 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 -- 10.20.193.40:0/1517018217 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f34b80056f0 con 0x7f34f40b3be0 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cffff640 1 -- 10.20.193.40:0/1517018217 <== mon.2 v2:10.20.193.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f34e0065b20 con 0x7f34f40b3be0 2026-02-24T17:25:11.155 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 10 librados: watch_flush enter 2026-02-24T17:25:11.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 10 librados: watch_flush exit 2026-02-24T17:25:11.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 20 client.4514.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 10 client.4514.objecter successfully canceled tick 2026-02-24T17:25:11.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.13 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 -- 10.20.193.40:0/1517018217 >> v2:10.20.193.120:6800/397309233 conn(0x7f34c40786e0 msgr2=0x7f34c4098b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 --2- 10.20.193.40:0/1517018217 >> v2:10.20.193.120:6800/397309233 conn(0x7f34c40786e0 0x7f34c4098b90 secure :-1 s=READY pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34e401a150 tx=0x7f34e40a7000 comp rx=0 tx=0).stop 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 -- 10.20.193.40:0/1517018217 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f34f40b3be0 msgr2=0x7f34f40591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 --2- 10.20.193.40:0/1517018217 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f34f40b3be0 0x7f34f40591c0 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34e000e870 tx=0x7f34e000ed30 comp rx=0 tx=0).stop 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 -- 10.20.193.40:0/1517018217 shutdown_connections 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 --2- 10.20.193.40:0/1517018217 >> v2:10.20.193.120:6800/397309233 conn(0x7f34c40786e0 0x7f34c4098b90 unknown :-1 s=CLOSED pgs=91 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 --2- 10.20.193.40:0/1517018217 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f34f415b390 0x7f34f4157430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 --2- 10.20.193.40:0/1517018217 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f34f415afc0 0x7f34f4155e50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 --2- 10.20.193.40:0/1517018217 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f34f40b3be0 0x7f34f40591c0 unknown :-1 s=CLOSED pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 -- 10.20.193.40:0/1517018217 >> 10.20.193.40:0/1517018217 conn(0x7f34f4054490 msgr2=0x7f34f4054860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 -- 10.20.193.40:0/1517018217 shutdown_connections 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 -- 10.20.193.40:0/1517018217 wait complete. 2026-02-24T17:25:11.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.147+0000 7f34cdffb640 1 librados: shutdown 2026-02-24T17:25:11.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f90940b50e0 con 0x7f9094059cd0 2026-02-24T17:25:11.159 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f90737fe640 1 -- 10.20.193.40:0/3257397432 <== mon.2 v2:10.20.193.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f907c069c90 con 0x7f9094059cd0 2026-02-24T17:25:11.159 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 10 librados: watch_flush enter 2026-02-24T17:25:11.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 10 librados: watch_flush exit 2026-02-24T17:25:11.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 20 client.4504.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 10 client.4504.objecter successfully canceled tick 2026-02-24T17:25:11.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 >> v2:10.20.193.120:6800/397309233 conn(0x7f90940b6b60 msgr2=0x7f90600f6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 --2- 10.20.193.40:0/3257397432 >> v2:10.20.193.120:6800/397309233 conn(0x7f90940b6b60 0x7f90600f6890 secure :-1 s=READY pgs=93 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90940b1be0 tx=0x7f9088007ad0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.161 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 msgr2=0x7f90600443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 0x7f90600443a0 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f907c01a920 tx=0x7f907c009190 comp rx=0 tx=0).stop 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 shutdown_connections 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 --2- 10.20.193.40:0/3257397432 >> v2:10.20.193.120:6800/397309233 conn(0x7f90940b6b60 0x7f90600f6890 unknown :-1 s=CLOSED pgs=93 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9060044db0 0x7f9060065230 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9094059cd0 0x7f90600443a0 unknown :-1 s=CLOSED pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 --2- 10.20.193.40:0/3257397432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9094161a10 0x7f9060023940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 >> 10.20.193.40:0/3257397432 conn(0x7f90940bb5e0 msgr2=0x7f90941691d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 shutdown_connections 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 -- 10.20.193.40:0/3257397432 wait complete. 2026-02-24T17:25:11.162 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.151+0000 7f9099415640 1 librados: shutdown 2026-02-24T17:25:11.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.1 2026-02-24T17:25:11.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.3 2026-02-24T17:25:11.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f492c16aa30 con 0x7f492c1208c0 2026-02-24T17:25:11.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f49217fa640 1 -- 10.20.193.40:0/3535898307 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f49140f97a0 con 0x7f492c1208c0 2026-02-24T17:25:11.171 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.2 2026-02-24T17:25:11.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 10 librados: watch_flush enter 2026-02-24T17:25:11.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 10 librados: watch_flush exit 2026-02-24T17:25:11.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 20 client.4551.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 10 client.4551.objecter successfully canceled tick 2026-02-24T17:25:11.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 >> v2:10.20.193.120:6800/397309233 conn(0x7f48fc074080 msgr2=0x7f48fc094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 --2- 10.20.193.40:0/3535898307 >> v2:10.20.193.120:6800/397309233 conn(0x7f48fc074080 0x7f48fc094530 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f492c16f660 tx=0x7f491c008040 comp rx=0 tx=0).stop 2026-02-24T17:25:11.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f492c1208c0 msgr2=0x7f492c11f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 --2- 10.20.193.40:0/3535898307 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f492c1208c0 0x7f492c11f920 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f491401b260 tx=0x7f4918005900 comp rx=0 tx=0).stop 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 shutdown_connections 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 --2- 10.20.193.40:0/3535898307 >> v2:10.20.193.120:6800/397309233 conn(0x7f48fc074080 0x7f48fc094530 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 --2- 10.20.193.40:0/3535898307 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f492c0773c0 0x7f492c160200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 --2- 10.20.193.40:0/3535898307 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f492c1208c0 0x7f492c11f920 unknown :-1 s=CLOSED pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 --2- 10.20.193.40:0/3535898307 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f49180048d0 0x7f492c078e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 >> 10.20.193.40:0/3535898307 conn(0x7f492c0b9d40 msgr2=0x7f492c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 shutdown_connections 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 -- 10.20.193.40:0/3535898307 wait complete. 2026-02-24T17:25:11.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.163+0000 7f4932ca7640 1 librados: shutdown 2026-02-24T17:25:11.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.5 2026-02-24T17:25:11.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f94f40599a0 con 0x7f94f415ae60 2026-02-24T17:25:11.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94f0ff9640 1 -- 10.20.193.40:0/2471987409 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f94e40600f0 con 0x7f94f415ae60 2026-02-24T17:25:11.245 INFO:teuthology.orchestra.run.trial040.stdout:90194313218 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 10 librados: watch_flush enter 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 10 librados: watch_flush exit 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 20 client.4560.objecter shutdown clearing up homeless session... 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 10 client.4560.objecter successfully canceled tick 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 >> v2:10.20.193.120:6800/397309233 conn(0x7f94c4074100 msgr2=0x7f94c40945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 --2- 10.20.193.40:0/2471987409 >> v2:10.20.193.120:6800/397309233 conn(0x7f94c4074100 0x7f94c40945b0 secure :-1 s=READY pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e00095c0 tx=0x7f94e00aa070 comp rx=0 tx=0).stop 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 msgr2=0x7f94f4161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f4161530 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e400c4f0 tx=0x7f94e400c9b0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 shutdown_connections 2026-02-24T17:25:11.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 --2- 10.20.193.40:0/2471987409 >> v2:10.20.193.120:6800/397309233 conn(0x7f94c4074100 0x7f94c40945b0 unknown :-1 s=CLOSED pgs=97 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f94f4165310 0x7f94f4168050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f94f415ae60 0x7f94f4161530 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 --2- 10.20.193.40:0/2471987409 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f94f405b890 0x7f94f4154600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:11.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 >> 10.20.193.40:0/2471987409 conn(0x7f94f40bb380 msgr2=0x7f94f40bb750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:11.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 shutdown_connections 2026-02-24T17:25:11.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 -- 10.20.193.40:0/2471987409 wait complete. 2026-02-24T17:25:11.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:11.235+0000 7f94fa3d9640 1 librados: shutdown 2026-02-24T17:25:11.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313218 for osd.7 2026-02-24T17:25:12.096 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-24T17:25:12.101 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T17:25:12.109 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-24T17:25:12.109 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-24T17:25:12.111 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T17:25:12.114 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-24T17:25:12.137 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-24T17:25:12.138 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-24T17:25:12.142 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T17:25:12.146 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-24T17:25:12.159 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-24T17:25:12.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f041c829640 1 Processor -- start 2026-02-24T17:25:12.160 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f041c829640 1 -- start start 2026-02-24T17:25:12.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f041c829640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f041805b3d0 0x7f04181659a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f041c829640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04180588f0 con 0x7f04181650e0 2026-02-24T17:25:12.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f041c829640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0418058bd0 con 0x7f041815b050 2026-02-24T17:25:12.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f041c829640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f0418058eb0 con 0x7f041805b3d0 2026-02-24T17:25:12.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0416d76640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7f041815b050 0x7f04180b8d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.40:48010/0 (socket says 10.20.193.40:48010) 2026-02-24T17:25:12.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0416d76640 1 -- 10.20.193.40:0/3775509016 learned_addr learned my addr 10.20.193.40:0/3775509016 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0416575640 1 --2- 10.20.193.40:0/3775509016 >> v2:10.20.193.109:3300/0 conn(0x7f041805b3d0 0x7f04181659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.163 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0415573640 1 -- 10.20.193.40:0/3775509016 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126623782 0 0) 0x7f0418058bd0 con 0x7f041815b050 2026-02-24T17:25:12.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0415573640 1 -- 10.20.193.40:0/3775509016 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0404003620 con 0x7f041815b050 2026-02-24T17:25:12.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0416575640 1 -- 10.20.193.40:0/3775509016 >> v1:10.20.193.109:6789/0 conn(0x7f041815b050 legacy=0x7f04180b8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0416575640 1 -- 10.20.193.40:0/3775509016 >> v1:10.20.193.94:6789/0 conn(0x7f04181650e0 legacy=0x7f041815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0416575640 1 -- 10.20.193.40:0/3775509016 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0418059190 con 0x7f041805b3d0 2026-02-24T17:25:12.166 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T17:25:12.169 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0416575640 1 --2- 10.20.193.40:0/3775509016 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041805b3d0 0x7f04181659a0 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=14722204361028941463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040c004780 tx=0x7f040c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc4fc6dd61d63697 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.169 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0415573640 1 -- 10.20.193.40:0/3775509016 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f040c0ab660 con 0x7f041805b3d0 2026-02-24T17:25:12.169 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0415573640 1 -- 10.20.193.40:0/3775509016 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c0b0070 con 0x7f041805b3d0 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.151+0000 7f0415573640 1 -- 10.20.193.40:0/3775509016 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f040c0aba40 con 0x7f041805b3d0 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- 10.20.193.40:0/3775509016 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041805b3d0 msgr2=0x7f04181659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 --2- 10.20.193.40:0/3775509016 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041805b3d0 0x7f04181659a0 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=14722204361028941463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040c004780 tx=0x7f040c01c530 comp rx=0 tx=0).stop 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- 10.20.193.40:0/3775509016 shutdown_connections 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 --2- 10.20.193.40:0/3775509016 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041805b3d0 0x7f04181659a0 unknown :-1 s=CLOSED pgs=93 gs=3 cs=0 l=1 c_cookie=14722204361028941463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- 10.20.193.40:0/3775509016 >> 10.20.193.40:0/3775509016 conn(0x7f04180bafd0 msgr2=0x7f04180bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- 10.20.193.40:0/3775509016 shutdown_connections 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- 10.20.193.40:0/3775509016 wait complete. 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 librados: starting msgr at 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 librados: starting objecter 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 Processor -- start 2026-02-24T17:25:12.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- start start 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 librados: setting wanted keys 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 librados: calling monclient init 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f041805b3d0 0x7f041812fb40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041815b050 0x7f04180ae1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04181650e0 0x7f041812e6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04181cbfd0 con 0x7f04181650e0 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f04181cbe50 con 0x7f041805b3d0 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f04181cc150 con 0x7f041815b050 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416d76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04181650e0 0x7f041812e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416d76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04181650e0 0x7f041812e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60074/0 (socket says 10.20.193.40:60074) 2026-02-24T17:25:12.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416d76640 1 -- 10.20.193.40:0/4238536184 learned_addr learned my addr 10.20.193.40:0/4238536184 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416575640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f041805b3d0 0x7f041812fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0415d74640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041815b050 0x7f04180ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416575640 1 -- 10.20.193.40:0/4238536184 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041815b050 msgr2=0x7f04180ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416575640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041815b050 0x7f04180ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416575640 1 -- 10.20.193.40:0/4238536184 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04181650e0 msgr2=0x7f041812e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416575640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04181650e0 0x7f041812e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416575640 1 -- 10.20.193.40:0/4238536184 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041812f1d0 con 0x7f041805b3d0 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f0416575640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f041805b3d0 0x7f041812fb40 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040c01a160 tx=0x7f040c0192d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f03feffd640 10 client.?.objecter ms_handle_connect 0x7f041805b3d0 2026-02-24T17:25:12.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f03feffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f03feffd640 1 -- 10.20.193.40:0/4238536184 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f040c0039f0 con 0x7f041805b3d0 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f03feffd640 1 -- 10.20.193.40:0/4238536184 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c0bb070 con 0x7f041805b3d0 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041812f4b0 con 0x7f041805b3d0 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f03feffd640 1 -- 10.20.193.40:0/4238536184 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f040c003db0 con 0x7f041805b3d0 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 10 client.4528.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04180b5960 con 0x7f041805b3d0 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 librados: init done 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.155+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04181659a0 con 0x7f041805b3d0 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 1 -- 10.20.193.40:0/4238536184 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f040c0de9d0 con 0x7f041805b3d0 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 1 --2- 10.20.193.40:0/4238536184 >> v2:10.20.193.120:6800/397309233 conn(0x7f03e4074070 0x7f03e4094520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 1 -- 10.20.193.40:0/4238536184 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f040c12fdb0 con 0x7f041805b3d0 2026-02-24T17:25:12.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 10 client.4528.objecter ms_dispatch2 0x7f0418000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 3 client.4528.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 3 client.4528.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 20 client.4528.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f0415d74640 1 --2- 10.20.193.40:0/4238536184 >> v2:10.20.193.120:6800/397309233 conn(0x7f03e4074070 0x7f03e4094520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f0415d74640 1 --2- 10.20.193.40:0/4238536184 >> v2:10.20.193.120:6800/397309233 conn(0x7f03e4074070 0x7f03e4094520 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0418128f10 tx=0x7f04000026e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 10 client.4528.objecter ms_handle_connect 0x7f03e4074070 2026-02-24T17:25:12.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.159+0000 7f03feffd640 1 -- 10.20.193.40:0/4238536184 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f040c016150 con 0x7f041805b3d0 2026-02-24T17:25:12.176 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T17:25:12.176 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T17:25:12.185 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-24T17:25:12.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 Processor -- start 2026-02-24T17:25:12.208 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- start start 2026-02-24T17:25:12.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb77e162640 1 Processor -- start 2026-02-24T17:25:12.209 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb77e162640 1 -- start start 2026-02-24T17:25:12.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f1e1c1618a0 0x7f1e1c0b3890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e1c16e870 con 0x7f1e1c16ba90 2026-02-24T17:25:12.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e1c16eb50 con 0x7f1e1c161c70 2026-02-24T17:25:12.210 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f1e1c16e620 con 0x7f1e1c1618a0 2026-02-24T17:25:12.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f18395640 1 Processor -- start 2026-02-24T17:25:12.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f18395640 1 -- start start 2026-02-24T17:25:12.211 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e2209a640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f1e1c1618a0 0x7f1e1c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e2209a640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f1e1c1618a0 0x7f1e1c0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60088/0 (socket says 10.20.193.40:60088) 2026-02-24T17:25:12.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e2209a640 1 -- 10.20.193.40:0/1205529170 learned_addr learned my addr 10.20.193.40:0/1205529170 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f550439d640 1 Processor -- start 2026-02-24T17:25:12.212 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f550439d640 1 -- start start 2026-02-24T17:25:12.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e2209a640 1 -- 10.20.193.40:0/1205529170 >> v1:10.20.193.109:6789/0 conn(0x7f1e1c161c70 legacy=0x7f1e1c16b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e2209a640 1 -- 10.20.193.40:0/1205529170 >> v1:10.20.193.94:6789/0 conn(0x7f1e1c16ba90 legacy=0x7f1e1c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e2209a640 1 -- 10.20.193.40:0/1205529170 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1c16ee30 con 0x7f1e1c1618a0 2026-02-24T17:25:12.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb77e162640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fb7780b5110 0x7fb7780b5520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb77e162640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb778059380 con 0x7fb778057eb0 2026-02-24T17:25:12.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb77e162640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb778164540 con 0x7fb778159f70 2026-02-24T17:25:12.213 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb77e162640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb778057a20 con 0x7fb7780b5110 2026-02-24T17:25:12.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1adb19640 1 Processor -- start 2026-02-24T17:25:12.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb776ffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fb7780b5110 0x7fb7780b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.214 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb777fff640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fb778057eb0 0x7fb778058310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49270/0 (socket says 10.20.193.40:49270) 2026-02-24T17:25:12.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb777fff640 1 -- 10.20.193.40:0/2268388500 learned_addr learned my addr 10.20.193.40:0/2268388500 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1adb19640 1 -- start start 2026-02-24T17:25:12.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f18395640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f2f1005d570 0x7f2f100b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f18395640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f101673c0 con 0x7f2f1005d1a0 2026-02-24T17:25:12.215 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f18395640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f101676a0 con 0x7f2f1016ada0 2026-02-24T17:25:12.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f18395640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2f10167980 con 0x7f2f1005d570 2026-02-24T17:25:12.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4149fdb640 1 Processor -- start 2026-02-24T17:25:12.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb7767fc640 1 -- 10.20.193.40:0/2268388500 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271491972 0 0) 0x7fb778059380 con 0x7fb778057eb0 2026-02-24T17:25:12.216 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb7767fc640 1 -- 10.20.193.40:0/2268388500 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb75c003620 con 0x7fb778057eb0 2026-02-24T17:25:12.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4149fdb640 1 -- start start 2026-02-24T17:25:12.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb776ffd640 1 -- 10.20.193.40:0/2268388500 >> v1:10.20.193.94:6789/0 conn(0x7fb778159f70 legacy=0x7fb778058c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb776ffd640 1 -- 10.20.193.40:0/2268388500 >> v1:10.20.193.40:6789/0 conn(0x7fb778057eb0 legacy=0x7fb778058310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.217 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb776ffd640 1 -- 10.20.193.40:0/2268388500 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7780b5b90 con 0x7fb7780b5110 2026-02-24T17:25:12.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f1610a640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7f2f1005d1a0 0x7f2f10166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:50172/0 (socket says 10.20.193.40:50172) 2026-02-24T17:25:12.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f1610a640 1 -- 10.20.193.40:0/934389011 learned_addr learned my addr 10.20.193.40:0/934389011 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.218 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f1690b640 1 --2- 10.20.193.40:0/934389011 >> v2:10.20.193.94:3300/0 conn(0x7f2f1005d570 0x7f2f100b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.220 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f1690b640 1 -- 10.20.193.40:0/934389011 >> v1:10.20.193.109:6789/0 conn(0x7f2f1016ada0 legacy=0x7f2f100bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f1690b640 1 -- 10.20.193.40:0/934389011 >> v1:10.20.193.94:6789/0 conn(0x7f2f1005d1a0 legacy=0x7f2f10166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f15108640 1 -- 10.20.193.40:0/934389011 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019544940 0 0) 0x7f2f101673c0 con 0x7f2f1005d1a0 2026-02-24T17:25:12.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f1690b640 1 -- 10.20.193.40:0/934389011 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f100b4430 con 0x7f2f1005d570 2026-02-24T17:25:12.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f902d405640 1 Processor -- start 2026-02-24T17:25:12.221 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f902d405640 1 -- start start 2026-02-24T17:25:12.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1adb19640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fa1a805d1a0 0x7fa1a805d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1adb19640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fa1a816ada0 0x7fa1a8166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1adb19640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1a8167130 con 0x7fa1a80bc470 2026-02-24T17:25:12.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1adb19640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a81673c0 con 0x7fa1a805d1a0 2026-02-24T17:25:12.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1adb19640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a81676a0 con 0x7fa1a816ada0 2026-02-24T17:25:12.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f550439d640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f54fc15ac20 0x7f54fc15aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f550439d640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc165370 con 0x7f54fc0b95b0 2026-02-24T17:25:12.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f550439d640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc0b8510 con 0x7f54fc0b38f0 2026-02-24T17:25:12.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f550439d640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f54fc0b87f0 con 0x7f54fc15ac20 2026-02-24T17:25:12.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f5502112640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f54fc15ac20 0x7f54fc15aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f5502112640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f54fc15ac20 0x7f54fc15aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:57706/0 (socket says 10.20.193.40:57706) 2026-02-24T17:25:12.223 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f5502112640 1 -- 10.20.193.40:0/3968469218 learned_addr learned my addr 10.20.193.40:0/3968469218 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e2209a640 1 --2- 10.20.193.40:0/1205529170 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c0b3890 secure :-1 s=READY pgs=157 gs=3 cs=0 l=1 c_cookie=3854644700478586946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e1c16e7a0 tx=0x7f1e0c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357e72eeab5e4042 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a7fff640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fa1a80bc470 0x7fa1a80b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49282/0 (socket says 10.20.193.40:49282) 2026-02-24T17:25:12.224 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a7fff640 1 -- 10.20.193.40:0/2921028432 learned_addr learned my addr 10.20.193.40:0/2921028432 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a77fe640 1 --2- 10.20.193.40:0/2921028432 >> v2:10.20.193.40:3300/0 conn(0x7fa1a805d1a0 0x7fa1a805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a6ffd640 1 --2- 10.20.193.40:0/2921028432 >> v2:10.20.193.94:3300/0 conn(0x7fa1a816ada0 0x7fa1a8166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a67fc640 1 -- 10.20.193.40:0/2921028432 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2546850233 0 0) 0x7fa1a8167130 con 0x7fa1a80bc470 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a67fc640 1 -- 10.20.193.40:0/2921028432 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa18c003620 con 0x7fa1a80bc470 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a77fe640 1 -- 10.20.193.40:0/2921028432 >> v2:10.20.193.94:3300/0 conn(0x7fa1a816ada0 msgr2=0x7fa1a8166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a77fe640 1 --2- 10.20.193.40:0/2921028432 >> v2:10.20.193.94:3300/0 conn(0x7fa1a816ada0 0x7fa1a8166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a77fe640 1 -- 10.20.193.40:0/2921028432 >> v1:10.20.193.40:6789/0 conn(0x7fa1a80bc470 legacy=0x7fa1a80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a77fe640 1 -- 10.20.193.40:0/2921028432 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a8167980 con 0x7fa1a805d1a0 2026-02-24T17:25:12.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fa1a6ffd640 1 --2- 10.20.193.40:0/2921028432 >> v2:10.20.193.94:3300/0 conn(0x7fa1a816ada0 0x7fa1a8166bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:12.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f5502112640 1 -- 10.20.193.40:0/3968469218 >> v1:10.20.193.109:6789/0 conn(0x7f54fc0b38f0 legacy=0x7f54fc164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f5502112640 1 -- 10.20.193.40:0/3968469218 >> v1:10.20.193.94:6789/0 conn(0x7f54fc0b95b0 legacy=0x7f54fc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f5502112640 1 -- 10.20.193.40:0/3968469218 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc0b8ad0 con 0x7f54fc15ac20 2026-02-24T17:25:12.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4149fdb640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f41441662f0 0x7f41440b9ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4149fdb640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41440b3e00 con 0x7f4144167f40 2026-02-24T17:25:12.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4149fdb640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41440b40e0 con 0x7f4144168310 2026-02-24T17:25:12.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4149fdb640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f4144168760 con 0x7f41441662f0 2026-02-24T17:25:12.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41437fe640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f4144167f40 0x7f41440b33a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49292/0 (socket says 10.20.193.40:49292) 2026-02-24T17:25:12.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41437fe640 1 -- 10.20.193.40:0/2807407058 learned_addr learned my addr 10.20.193.40:0/2807407058 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4143fff640 1 --2- 10.20.193.40:0/2807407058 >> v2:10.20.193.109:3300/0 conn(0x7f41441662f0 0x7f41440b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e21098640 1 -- 10.20.193.40:0/1205529170 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e0c0a6040 con 0x7f1e1c1618a0 2026-02-24T17:25:12.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e21098640 1 -- 10.20.193.40:0/1205529170 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0c0af070 con 0x7f1e1c1618a0 2026-02-24T17:25:12.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e21098640 1 -- 10.20.193.40:0/1205529170 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e0c0aa8a0 con 0x7f1e1c1618a0 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f902d405640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f902805d570 0x7f90280b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f902d405640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90281673c0 con 0x7f902805d1a0 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f902d405640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90281676a0 con 0x7f902816ada0 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f902d405640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f9028167980 con 0x7f902805d570 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9026ffd640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f902805d1a0 0x7f9028166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49300/0 (socket says 10.20.193.40:49300) 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9026ffd640 1 -- 10.20.193.40:0/3765052545 learned_addr learned my addr 10.20.193.40:0/3765052545 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f90277fe640 1 --2- 10.20.193.40:0/3765052545 >> v2:10.20.193.109:3300/0 conn(0x7f902805d570 0x7f90280b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737126729 0 0) 0x7f90281673c0 con 0x7f902805d1a0 2026-02-24T17:25:12.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9014003620 con 0x7f902805d1a0 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966822738 0 0) 0x7f41440b3e00 con 0x7f4144167f40 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4128003620 con 0x7f4144167f40 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2965218656 0 0) 0x7f4128003620 con 0x7f4144167f40 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 >> v2:10.20.193.109:3300/0 conn(0x7f41441662f0 msgr2=0x7f41440b9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 --2- 10.20.193.40:0/2807407058 >> v2:10.20.193.109:3300/0 conn(0x7f41441662f0 0x7f41440b9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 >> v1:10.20.193.109:6789/0 conn(0x7f4144168310 legacy=0x7f4144165be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41440b43c0 con 0x7f4144167f40 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f4130002e80 con 0x7f4144167f40 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 >> v1:10.20.193.40:6789/0 conn(0x7f4144167f40 legacy=0x7f41440b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f4128003bf0 0x7f4128004000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649784818 0 0) 0x7f90281676a0 con 0x7f902816ada0 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41280048d0 0x7f4128004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41280053a0 0x7f4128065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90281673c0 con 0x7f902816ada0 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4144168760 con 0x7f41280048d0 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f41280662d0 con 0x7f41280053a0 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f41280664d0 con 0x7f4128003bf0 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4142ffd640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41280048d0 0x7f4128004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- 10.20.193.40:0/1205529170 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 msgr2=0x7f1e1c0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 --2- 10.20.193.40:0/1205529170 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c0b3890 secure :-1 s=READY pgs=157 gs=3 cs=0 l=1 c_cookie=3854644700478586946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e1c16e7a0 tx=0x7f1e0c01c560 comp rx=0 tx=0).stop 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 205838761 0 0) 0x7f9014003620 con 0x7f902805d1a0 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 >> v2:10.20.193.109:3300/0 conn(0x7f902805d570 msgr2=0x7f90280b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 --2- 10.20.193.40:0/3765052545 >> v2:10.20.193.109:3300/0 conn(0x7f902805d570 0x7f90280b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- 10.20.193.40:0/1205529170 shutdown_connections 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 --2- 10.20.193.40:0/1205529170 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c0b3890 unknown :-1 s=CLOSED pgs=157 gs=3 cs=0 l=1 c_cookie=3854644700478586946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- 10.20.193.40:0/1205529170 >> 10.20.193.40:0/1205529170 conn(0x7f1e1c0b8fd0 msgr2=0x7f1e1c0b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 >> v1:10.20.193.94:6789/0 conn(0x7f902816ada0 legacy=0x7f90280bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90280b4430 con 0x7f902805d1a0 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f901c002e80 con 0x7f902805d1a0 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- 10.20.193.40:0/1205529170 shutdown_connections 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f41437fe640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f4128003bf0 0x7f4128004000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f1e24325640 1 -- 10.20.193.40:0/1205529170 wait complete. 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 >> v1:10.20.193.40:6789/0 conn(0x7f902805d1a0 legacy=0x7f9028166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014003dd0 0x7f90140041c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4143fff640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41280053a0 0x7f4128065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90140048d0 0x7f9014004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9014005340 0x7f9014065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9028167980 con 0x7f9014005340 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9014066280 con 0x7f90140048d0 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9014066480 con 0x7f9014003dd0 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb776ffd640 1 --2- 10.20.193.40:0/2268388500 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 0x7fb7780b5520 secure :-1 s=READY pgs=160 gs=3 cs=0 l=1 c_cookie=11824646961507256546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb768009840 tx=0x7fb76801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41995c3070ac8e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4142ffd640 1 -- 10.20.193.40:0/2807407058 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f4128003bf0 msgr2=0x7f4128004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4142ffd640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f4128003bf0 0x7f4128004000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f90277fe640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9014005340 0x7f9014065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f90267fc640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90140048d0 0x7f9014004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4142ffd640 1 -- 10.20.193.40:0/2807407058 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41280053a0 msgr2=0x7f4128065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4142ffd640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41280053a0 0x7f4128065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4142ffd640 1 -- 10.20.193.40:0/2807407058 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4128003620 con 0x7f41280048d0 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f4143fff640 1 -- 10.20.193.40:0/2807407058 reap_dead start 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb7767fc640 1 -- 10.20.193.40:0/2268388500 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7680ab650 con 0x7fb7780b5110 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb7767fc640 1 -- 10.20.193.40:0/2268388500 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7680b0070 con 0x7fb7780b5110 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7fb7767fc640 1 -- 10.20.193.40:0/2268388500 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7680aba30 con 0x7fb7780b5110 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f9026ffd640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014003dd0 0x7f90140041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f90277fe640 1 -- 10.20.193.40:0/3765052545 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014003dd0 msgr2=0x7f90140041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f90277fe640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014003dd0 0x7f90140041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f90277fe640 1 -- 10.20.193.40:0/3765052545 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90140048d0 msgr2=0x7f9014004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f90277fe640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f90140048d0 0x7f9014004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f90277fe640 1 -- 10.20.193.40:0/3765052545 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9014003620 con 0x7f9014005340 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.199+0000 7f2f1690b640 1 --2- 10.20.193.40:0/934389011 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1005d570 0x7f2f100b4f10 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=4296206957550056320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f0c00acf0 tx=0x7f2f0c01d8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b9f317732553380 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f15108640 1 -- 10.20.193.40:0/934389011 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f0c0b3070 con 0x7f2f1005d570 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f15108640 1 -- 10.20.193.40:0/934389011 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c0a68b0 con 0x7f2f1005d570 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f15108640 1 -- 10.20.193.40:0/934389011 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f0c0a6cc0 con 0x7f2f1005d570 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 --2- 10.20.193.40:0/3968469218 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 0x7f54fc15aff0 secure :-1 s=READY pgs=98 gs=3 cs=0 l=1 c_cookie=4122553984893554320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54ec0090a0 tx=0x7f54ec01c5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39364101ccf38e90 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1a77fe640 1 --2- 10.20.193.40:0/2921028432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a805d1a0 0x7fa1a805d570 secure :-1 s=READY pgs=161 gs=2 cs=0 l=1 c_cookie=13894028093452790272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1a8161140 tx=0x7fa19401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d180eff18d2a00 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 librados: starting msgr at 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 librados: starting objecter 2026-02-24T17:25:12.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1a67fc640 1 -- 10.20.193.40:0/2921028432 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1940aa450 con 0x7fa1a805d1a0 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1a67fc640 1 -- 10.20.193.40:0/2921028432 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1940af070 con 0x7fa1a805d1a0 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1a67fc640 1 -- 10.20.193.40:0/2921028432 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1940aa830 con 0x7fa1a805d1a0 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5501110640 1 -- 10.20.193.40:0/3968469218 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54ec0a8630 con 0x7f54fc15ac20 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- 10.20.193.40:0/2268388500 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 msgr2=0x7fb7780b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 --2- 10.20.193.40:0/2268388500 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 0x7fb7780b5520 secure :-1 s=READY pgs=160 gs=3 cs=0 l=1 c_cookie=11824646961507256546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb768009840 tx=0x7fb76801c540 comp rx=0 tx=0).stop 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 Processor -- start 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- 10.20.193.40:0/2268388500 shutdown_connections 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 --2- 10.20.193.40:0/2268388500 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 0x7fb7780b5520 unknown :-1 s=CLOSED pgs=160 gs=3 cs=0 l=1 c_cookie=11824646961507256546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- 10.20.193.40:0/2268388500 >> 10.20.193.40:0/2268388500 conn(0x7fb7780b9d40 msgr2=0x7fb7780ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 -- start start 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 librados: setting wanted keys 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- 10.20.193.40:0/2268388500 shutdown_connections 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- 10.20.193.40:0/2268388500 wait complete. 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 librados: calling monclient init 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- 10.20.193.40:0/934389011 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1005d570 msgr2=0x7f2f100b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 --2- 10.20.193.40:0/934389011 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1005d570 0x7f2f100b4f10 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=4296206957550056320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f0c00acf0 tx=0x7f2f0c01d8f0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- 10.20.193.40:0/934389011 shutdown_connections 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 --2- 10.20.193.40:0/934389011 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1005d570 0x7f2f100b4f10 unknown :-1 s=CLOSED pgs=87 gs=3 cs=0 l=1 c_cookie=4296206957550056320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- 10.20.193.40:0/934389011 >> 10.20.193.40:0/934389011 conn(0x7f2f100bd200 msgr2=0x7f2f100bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- 10.20.193.40:0/934389011 shutdown_connections 2026-02-24T17:25:12.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- 10.20.193.40:0/934389011 wait complete. 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- 10.20.193.40:0/2921028432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a805d1a0 msgr2=0x7fa1a805d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 --2- 10.20.193.40:0/2921028432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a805d1a0 0x7fa1a805d570 secure :-1 s=READY pgs=161 gs=2 cs=0 l=1 c_cookie=13894028093452790272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1a8161140 tx=0x7fa19401c4f0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- 10.20.193.40:0/2921028432 shutdown_connections 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5501110640 1 -- 10.20.193.40:0/3968469218 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec0a87d0 con 0x7f54fc15ac20 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5501110640 1 -- 10.20.193.40:0/3968469218 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54ec0a8bc0 con 0x7f54fc15ac20 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- 10.20.193.40:0/3968469218 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 msgr2=0x7f54fc15aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 --2- 10.20.193.40:0/3968469218 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 0x7f54fc15aff0 secure :-1 s=READY pgs=98 gs=3 cs=0 l=1 c_cookie=4122553984893554320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54ec0090a0 tx=0x7f54ec01c5f0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c120e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 --2- 10.20.193.40:0/2921028432 >> v2:10.20.193.94:3300/0 conn(0x7fa1a816ada0 0x7fa1a8166bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1e1c161c70 0x7f1e1c166dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1e1c16ba90 0x7f1e1c121640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c0b4a90 con 0x7f1e1c1618a0 2026-02-24T17:25:12.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 --2- 10.20.193.40:0/2921028432 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a805d1a0 0x7fa1a805d570 unknown :-1 s=CLOSED pgs=161 gs=2 cs=0 l=1 c_cookie=13894028093452790272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c0b4910 con 0x7f1e1c161c70 2026-02-24T17:25:12.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c0b4c10 con 0x7f1e1c16ba90 2026-02-24T17:25:12.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- 10.20.193.40:0/2921028432 >> 10.20.193.40:0/2921028432 conn(0x7fa1a80bd200 msgr2=0x7fa1a80bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- 10.20.193.40:0/2921028432 shutdown_connections 2026-02-24T17:25:12.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4142ffd640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41280048d0 0x7f4128004d40 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=16509741782499265486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4134003010 tx=0x7f413401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51e62adc74b0bce server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- 10.20.193.40:0/2921028432 wait complete. 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- 10.20.193.40:0/3968469218 shutdown_connections 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 --2- 10.20.193.40:0/3968469218 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 0x7f54fc15aff0 unknown :-1 s=CLOSED pgs=98 gs=3 cs=0 l=1 c_cookie=4122553984893554320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- 10.20.193.40:0/3968469218 >> 10.20.193.40:0/3968469218 conn(0x7f54fc0b9b50 msgr2=0x7f54fc0b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- 10.20.193.40:0/3968469218 shutdown_connections 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- 10.20.193.40:0/3968469218 wait complete. 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c120e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f90277fe640 1 -- 10.20.193.40:0/3765052545 reap_dead start 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4134002c60 con 0x7f41280048d0 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4134006b10 con 0x7f41280048d0 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f41427fc640 1 -- 10.20.193.40:0/2807407058 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4134007030 con 0x7f41280048d0 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c120e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60138/0 (socket says 10.20.193.40:60138) 2026-02-24T17:25:12.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 -- 10.20.193.40:0/1699335273 learned_addr learned my addr 10.20.193.40:0/1699335273 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2289b640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1e1c16ba90 0x7f1e1c121640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e21899640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1e1c161c70 0x7f1e1c166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f90277fe640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9014005340 0x7f9014065a90 secure :-1 s=READY pgs=163 gs=5 cs=0 l=1 c_cookie=14024464462045417404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901800aeb0 tx=0x7f901801dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a0e81f994e8fbc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f901800ab80 con 0x7f9014005340 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90180a6b50 con 0x7f9014005340 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f9025ffb640 1 -- 10.20.193.40:0/3765052545 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90180ae430 con 0x7f9014005340 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 librados: starting msgr at 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 librados: starting objecter 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 librados: starting msgr at 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 librados: starting objecter 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 Processor -- start 2026-02-24T17:25:12.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 Processor -- start 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- start start 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 librados: setting wanted keys 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 librados: calling monclient init 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 -- 10.20.193.40:0/1699335273 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1e1c16ba90 msgr2=0x7f1e1c121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1e1c16ba90 0x7f1e1c121640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 -- 10.20.193.40:0/1699335273 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1e1c161c70 msgr2=0x7f1e1c166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1e1c161c70 0x7f1e1c166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 -- 10.20.193.40:0/1699335273 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1c165a50 con 0x7f1e1c1618a0 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- start start 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 librados: setting wanted keys 2026-02-24T17:25:12.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 librados: calling monclient init 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- 10.20.193.40:0/2807407058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41280048d0 msgr2=0x7f4128004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41280048d0 0x7f4128004d40 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=16509741782499265486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4134003010 tx=0x7f413401c450 comp rx=0 tx=0).stop 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- 10.20.193.40:0/2807407058 shutdown_connections 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 --2- 10.20.193.40:0/2807407058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41280048d0 0x7f4128004d40 unknown :-1 s=CLOSED pgs=162 gs=4 cs=0 l=1 c_cookie=16509741782499265486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- 10.20.193.40:0/2807407058 >> 10.20.193.40:0/2807407058 conn(0x7f41440bb5e0 msgr2=0x7f41440b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- 10.20.193.40:0/2807407058 shutdown_connections 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- 10.20.193.40:0/2807407058 wait complete. 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f902d405640 1 -- 10.20.193.40:0/3765052545 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9014005340 msgr2=0x7f9014065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f902d405640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9014005340 0x7f9014065a90 secure :-1 s=READY pgs=163 gs=5 cs=0 l=1 c_cookie=14024464462045417404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901800aeb0 tx=0x7f901801dc40 comp rx=0 tx=0).stop 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e2209a640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c120e10 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e0c002410 tx=0x7f1e0c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e02ffd640 10 client.?.objecter ms_handle_connect 0x7f1e1c1618a0 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e02ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f902d405640 1 -- 10.20.193.40:0/3765052545 shutdown_connections 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f902d405640 1 --2- 10.20.193.40:0/3765052545 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9014005340 0x7f9014065a90 unknown :-1 s=CLOSED pgs=163 gs=5 cs=0 l=1 c_cookie=14024464462045417404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f902d405640 1 -- 10.20.193.40:0/3765052545 >> 10.20.193.40:0/3765052545 conn(0x7f90280bd200 msgr2=0x7f90280bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 librados: starting msgr at 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 librados: starting objecter 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e02ffd640 1 -- 10.20.193.40:0/1699335273 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e0c004020 con 0x7f1e1c1618a0 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e02ffd640 1 -- 10.20.193.40:0/1699335273 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0c0041c0 con 0x7f1e1c1618a0 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e02ffd640 1 -- 10.20.193.40:0/1699335273 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e0c004590 con 0x7f1e1c1618a0 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1c165d30 con 0x7f1e1c1618a0 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 10 client.4587.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e1c1662f0 con 0x7f1e1c1618a0 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 librados: init done 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f1005d1a0 0x7f2f10169500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f1005d570 0x7f2f1017aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1016ada0 0x7f2f1017b030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1005e2b0 con 0x7f2f1005d570 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2f101ce520 con 0x7f2f1016ada0 2026-02-24T17:25:12.243 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2f100b5860 con 0x7f2f1005d1a0 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 Processor -- start 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- start start 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 librados: setting wanted keys 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 librados: calling monclient init 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb778057eb0 0x7fb7781797f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 0x7fb7781614e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb778159f70 0x7fb778162b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb77815a4c0 con 0x7fb7780b5110 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb77815a340 con 0x7fb778057eb0 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781cb010 con 0x7fb778159f70 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f15909640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f1005d570 0x7f2f1017aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f15909640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f1005d570 0x7f2f1017aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60146/0 (socket says 10.20.193.40:60146) 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f15909640 1 -- 10.20.193.40:0/2530855689 learned_addr learned my addr 10.20.193.40:0/2530855689 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.244 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f1690b640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1016ada0 0x7f2f1017b030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb776ffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 0x7fb7781614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f1610a640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f1005d1a0 0x7f2f10169500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 librados: starting msgr at 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 librados: starting objecter 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb776ffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 0x7fb7781614e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60160/0 (socket says 10.20.193.40:60160) 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb777fff640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb778159f70 0x7fb778162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb776ffd640 1 -- 10.20.193.40:0/3972747916 learned_addr learned my addr 10.20.193.40:0/3972747916 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb7777fe640 1 --2- 10.20.193.40:0/3972747916 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb778057eb0 0x7fb7781797f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 Processor -- start 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 librados: starting msgr at 2026-02-24T17:25:12.245 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 librados: starting objecter 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54fc0b38f0 0x7f54fc154b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f54fc0b95b0 0x7f54fc17e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 0x7f54fc058820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc167c40 con 0x7f54fc0b38f0 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc1659a0 con 0x7f54fc0b95b0 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f550439d640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc165040 con 0x7f54fc15ac20 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e1c0b3890 con 0x7f1e1c1618a0 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 Processor -- start 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- start start 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 librados: setting wanted keys 2026-02-24T17:25:12.246 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 librados: calling monclient init 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f1690b640 1 -- 10.20.193.40:0/2530855689 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f1005d1a0 msgr2=0x7f2f10169500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f1690b640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f1005d1a0 0x7f2f10169500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f1690b640 1 -- 10.20.193.40:0/2530855689 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f1005d570 msgr2=0x7f2f1017aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f1690b640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f1005d570 0x7f2f1017aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f1690b640 1 -- 10.20.193.40:0/2530855689 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f101663f0 con 0x7f2f1016ada0 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54fc0b38f0 0x7f54fc154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54fc0b38f0 0x7f54fc154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60164/0 (socket says 10.20.193.40:60164) 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 -- 10.20.193.40:0/3289748108 learned_addr learned my addr 10.20.193.40:0/3289748108 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb777fff640 1 -- 10.20.193.40:0/3972747916 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb778057eb0 msgr2=0x7fb7781797f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb777fff640 1 --2- 10.20.193.40:0/3972747916 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb778057eb0 0x7fb7781797f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb777fff640 1 -- 10.20.193.40:0/3972747916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 msgr2=0x7fb7781614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb777fff640 1 --2- 10.20.193.40:0/3972747916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 0x7fb7781614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb777fff640 1 -- 10.20.193.40:0/3972747916 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb778161a20 con 0x7fb778159f70 2026-02-24T17:25:12.247 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5501911640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f54fc0b95b0 0x7f54fc17e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502913640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 0x7f54fc058820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f1690b640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1016ada0 0x7f2f1017b030 secure :-1 s=READY pgs=88 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f0c01b520 tx=0x7f2f0c01a690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2ef6ffd640 10 client.?.objecter ms_handle_connect 0x7f2f1016ada0 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2ef6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 -- 10.20.193.40:0/3289748108 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 msgr2=0x7f54fc058820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 0x7f54fc058820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 -- 10.20.193.40:0/3289748108 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f54fc0b95b0 msgr2=0x7f54fc17e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f54fc0b95b0 0x7f54fc17e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f41280048d0 0x7f41440562b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41440b55c0 0x7f4144135160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41440b6dc0 0x7f4144139100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f41440b4c60 con 0x7f41440b55c0 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f41440b4980 con 0x7f41440b6dc0 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4149fdb640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f4144165be0 con 0x7f41280048d0 2026-02-24T17:25:12.248 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f902d405640 1 -- 10.20.193.40:0/3765052545 shutdown_connections 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb777fff640 1 --2- 10.20.193.40:0/3972747916 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb778159f70 0x7fb778162b20 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb76c00da70 tx=0x7fb76c00df30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb753fff640 10 client.?.objecter ms_handle_connect 0x7fb778159f70 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb753fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f902d405640 1 -- 10.20.193.40:0/3765052545 wait complete. 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 -- 10.20.193.40:0/3289748108 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc0b5fa0 con 0x7f54fc0b38f0 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2ef6ffd640 1 -- 10.20.193.40:0/2530855689 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f0c0bc070 con 0x7f2f1016ada0 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2ef6ffd640 1 -- 10.20.193.40:0/2530855689 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c0b8480 con 0x7f2f1016ada0 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f101666d0 con 0x7f2f1016ada0 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb753fff640 1 -- 10.20.193.40:0/3972747916 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb76c018070 con 0x7fb778159f70 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb778161cf0 con 0x7fb778159f70 2026-02-24T17:25:12.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f41437fe640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f41280048d0 0x7f41440562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2ef6ffd640 1 -- 10.20.193.40:0/2530855689 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f0c0b3040 con 0x7f2f1016ada0 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f41437fe640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f41280048d0 0x7f41440562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:57810/0 (socket says 10.20.193.40:57810) 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4142ffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41440b55c0 0x7f4144135160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f41437fe640 1 -- 10.20.193.40:0/2274332075 learned_addr learned my addr 10.20.193.40:0/2274332075 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 10 client.4543.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f10166c90 con 0x7f2f1016ada0 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- start start 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 librados: setting wanted keys 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4143fff640 1 --2- 10.20.193.40:0/2274332075 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41440b6dc0 0x7f4144139100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f2f18395640 1 librados: init done 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 librados: calling monclient init 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa1a805d1a0 0x7fa1a8169500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa1a80bc470 0x7fa1a81295e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 10 client.4568.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7781622b0 con 0x7fb778159f70 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb77e162640 1 librados: init done 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a816ada0 0x7fa1a8129b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a815cb80 con 0x7fa1a816ada0 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a815d9e0 con 0x7fa1a80bc470 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1adb19640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a815d860 con 0x7fa1a805d1a0 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb753fff640 1 -- 10.20.193.40:0/3972747916 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76c00bb30 con 0x7fb778159f70 2026-02-24T17:25:12.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fb753fff640 1 -- 10.20.193.40:0/3972747916 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb76c013400 con 0x7fb778159f70 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4142ffd640 1 -- 10.20.193.40:0/2274332075 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f41280048d0 msgr2=0x7f41440562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4142ffd640 1 --2- 10.20.193.40:0/2274332075 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f41280048d0 0x7f41440562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4142ffd640 1 -- 10.20.193.40:0/2274332075 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41440b6dc0 msgr2=0x7f4144139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4142ffd640 1 --2- 10.20.193.40:0/2274332075 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41440b6dc0 0x7f4144139100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f4142ffd640 1 -- 10.20.193.40:0/2274332075 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4144058300 con 0x7f41440b55c0 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f4142ffd640 1 --2- 10.20.193.40:0/2274332075 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41440b55c0 0x7f4144135160 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4134003010 tx=0x7f4128005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f411ffff640 10 client.?.objecter ms_handle_connect 0x7f41440b55c0 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f411ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 librados: starting msgr at 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 librados: starting objecter 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 1 -- 10.20.193.40:0/1699335273 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f1e0c0c5060 con 0x7f1e1c1618a0 2026-02-24T17:25:12.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f5502112640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54fc0b38f0 0x7f54fc154b40 secure :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54ec01cb60 tx=0x7f54ec01ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f54e2ffd640 10 client.?.objecter ms_handle_connect 0x7f54fc0b38f0 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7f54e2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1a7fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a816ada0 0x7fa1a8129b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1a77fe640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa1a805d1a0 0x7fa1a8169500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1a77fe640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa1a805d1a0 0x7fa1a8169500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:57814/0 (socket says 10.20.193.40:57814) 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.203+0000 7fa1a77fe640 1 -- 10.20.193.40:0/361062604 learned_addr learned my addr 10.20.193.40:0/361062604 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1a7fff640 1 -- 10.20.193.40:0/361062604 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa1a805d1a0 msgr2=0x7fa1a8169500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1a7fff640 1 --2- 10.20.193.40:0/361062604 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa1a805d1a0 0x7fa1a8169500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1a7fff640 1 -- 10.20.193.40:0/361062604 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa1a80bc470 msgr2=0x7fa1a81295e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1a7fff640 1 --2- 10.20.193.40:0/361062604 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa1a80bc470 0x7fa1a81295e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2edc005130 con 0x7f2f1016ada0 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1a7fff640 1 -- 10.20.193.40:0/361062604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a81cb2d0 con 0x7fa1a816ada0 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1a7fff640 1 --2- 10.20.193.40:0/361062604 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a816ada0 0x7fa1a8129b20 secure :-1 s=READY pgs=167 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa19c00da70 tx=0x7fa19c00de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 Processor -- start 2026-02-24T17:25:12.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa183fff640 10 client.?.objecter ms_handle_connect 0x7fa1a816ada0 2026-02-24T17:25:12.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa183fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 -- start start 2026-02-24T17:25:12.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 librados: setting wanted keys 2026-02-24T17:25:12.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 librados: calling monclient init 2026-02-24T17:25:12.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7780b54e0 con 0x7fb778159f70 2026-02-24T17:25:12.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 1 --2- 10.20.193.40:0/1699335273 >> v2:10.20.193.120:6800/397309233 conn(0x7f1dec074100 0x7f1dec0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 1 -- 10.20.193.40:0/1699335273 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f1e0c130150 con 0x7f1e1c1618a0 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 10 client.4587.objecter ms_dispatch2 0x7f1e1c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 3 client.4587.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 3 client.4587.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 20 client.4587.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e21899640 1 --2- 10.20.193.40:0/1699335273 >> v2:10.20.193.120:6800/397309233 conn(0x7f1dec074100 0x7f1dec0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2ef6ffd640 1 -- 10.20.193.40:0/2530855689 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f2f0c0b8850 con 0x7f2f1016ada0 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014005340 0x7f9028140860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9028147a60 0x7f9028147ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9028149220 0x7f9028149650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90280b49f0 con 0x7f9028147a60 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f902805d940 con 0x7f9028149220 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9028166bf0 con 0x7f9014005340 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9028147a60 0x7f9028147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9028147a60 0x7f9028147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60194/0 (socket says 10.20.193.40:60194) 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 -- 10.20.193.40:0/2967685557 learned_addr learned my addr 10.20.193.40:0/2967685557 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2ef6ffd640 1 --2- 10.20.193.40:0/2530855689 >> v2:10.20.193.120:6800/397309233 conn(0x7f2ee0074100 0x7f2ee00945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f9026ffd640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014005340 0x7f9028140860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90277fe640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9028149220 0x7f9028149650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2ef6ffd640 1 -- 10.20.193.40:0/2530855689 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f2f0c131d80 con 0x7f2f1016ada0 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2ef6ffd640 10 client.4543.objecter ms_dispatch2 0x7f2f10000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2ef6ffd640 3 client.4543.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2ef6ffd640 3 client.4543.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e21899640 1 --2- 10.20.193.40:0/1699335273 >> v2:10.20.193.120:6800/397309233 conn(0x7f1dec074100 0x7f1dec0945b0 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e1c168b70 tx=0x7f1e100037b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 10 client.4587.objecter ms_handle_connect 0x7f1dec074100 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2ef6ffd640 20 client.4543.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2f1610a640 1 --2- 10.20.193.40:0/2530855689 >> v2:10.20.193.120:6800/397309233 conn(0x7f2ee0074100 0x7f2ee00945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 -- 10.20.193.40:0/2967685557 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014005340 msgr2=0x7f9028140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014005340 0x7f9028140860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 -- 10.20.193.40:0/2967685557 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9028149220 msgr2=0x7f9028149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9028149220 0x7f9028149650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 -- 10.20.193.40:0/2967685557 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9028140da0 con 0x7f9028147a60 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90267fc640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9028147a60 0x7f9028147ed0 secure :-1 s=READY pgs=168 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901000ea50 tx=0x7f901000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90077fe640 10 client.?.objecter ms_handle_connect 0x7f9028147a60 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90077fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 1 -- 10.20.193.40:0/3972747916 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fb76c03a8f0 con 0x7fb778159f70 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 1 --2- 10.20.193.40:0/3972747916 >> v2:10.20.193.120:6800/397309233 conn(0x7fb748074180 0x7fb748094630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 1 -- 10.20.193.40:0/3972747916 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fb76c096bc0 con 0x7fb778159f70 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 10 client.4568.objecter ms_dispatch2 0x7fb778000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 3 client.4568.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 3 client.4568.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 20 client.4568.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb7777fe640 1 --2- 10.20.193.40:0/3972747916 >> v2:10.20.193.120:6800/397309233 conn(0x7fb748074180 0x7fb748094630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2ef6ffd640 10 client.4543.objecter ms_handle_connect 0x7f2ee0074100 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f2f1610a640 1 --2- 10.20.193.40:0/2530855689 >> v2:10.20.193.120:6800/397309233 conn(0x7f2ee0074100 0x7f2ee00945b0 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f00007b60 tx=0x7f2f00007af0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.258 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb7777fe640 1 --2- 10.20.193.40:0/3972747916 >> v2:10.20.193.120:6800/397309233 conn(0x7fb748074180 0x7fb748094630 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7640037b0 tx=0x7fb7640037e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 10 client.4568.objecter ms_handle_connect 0x7fb748074180 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f54e2ffd640 1 -- 10.20.193.40:0/3289748108 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54ec004240 con 0x7f54fc0b38f0 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f411ffff640 1 -- 10.20.193.40:0/2274332075 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41340bb070 con 0x7f41440b55c0 2026-02-24T17:25:12.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41440b5a40 con 0x7f41440b55c0 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54fc0b6210 con 0x7f54fc0b38f0 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f550439d640 10 client.4596.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54fc0b67d0 con 0x7f54fc0b38f0 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f550439d640 1 librados: init done 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f4149fdb640 10 client.4599.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41440b6000 con 0x7f41440b55c0 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f4149fdb640 1 librados: init done 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90077fe640 1 -- 10.20.193.40:0/2967685557 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f901000cd10 con 0x7f9028147a60 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9028149b90 con 0x7f9028147a60 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa183fff640 1 -- 10.20.193.40:0/361062604 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa19c018070 con 0x7fa1a816ada0 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa183fff640 1 -- 10.20.193.40:0/361062604 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa19c00bb30 con 0x7fa1a816ada0 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa183fff640 1 -- 10.20.193.40:0/361062604 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa19c013400 con 0x7fa1a816ada0 2026-02-24T17:25:12.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f1e02ffd640 1 -- 10.20.193.40:0/1699335273 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f1e0c016210 con 0x7f1e1c1618a0 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f411ffff640 1 -- 10.20.193.40:0/2274332075 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4134006b10 con 0x7f41440b55c0 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f411ffff640 1 -- 10.20.193.40:0/2274332075 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4134006cc0 con 0x7f41440b55c0 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f54e2ffd640 1 -- 10.20.193.40:0/3289748108 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec0a87d0 con 0x7f54fc0b38f0 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f54e2ffd640 1 -- 10.20.193.40:0/3289748108 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54ec003710 con 0x7f54fc0b38f0 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a8165eb0 con 0x7fa1a816ada0 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1adb19640 10 client.4602.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a8166470 con 0x7fa1a816ada0 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fa1adb19640 1 librados: init done 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 10 client.4605.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9028141350 con 0x7f9028147a60 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 librados: init done 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90077fe640 1 -- 10.20.193.40:0/2967685557 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9010019070 con 0x7f9028147a60 2026-02-24T17:25:12.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f90077fe640 1 -- 10.20.193.40:0/2967685557 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90100146a0 con 0x7f9028147a60 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7fb753fff640 1 -- 10.20.193.40:0/3972747916 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fb76c0609a0 con 0x7fb778159f70 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54fc15aff0 con 0x7f54fc0b38f0 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.207+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9028167600 con 0x7f9028147a60 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f2ef6ffd640 1 -- 10.20.193.40:0/2530855689 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f2f0c0174e0 con 0x7f2f1016ada0 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4144165fc0 con 0x7f41440b55c0 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a80b85d0 con 0x7fa1a816ada0 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f411ffff640 1 -- 10.20.193.40:0/2274332075 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f41340050d0 con 0x7f41440b55c0 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f411ffff640 1 --2- 10.20.193.40:0/2274332075 >> v2:10.20.193.120:6800/397309233 conn(0x7f4114074100 0x7f41140945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f41437fe640 1 --2- 10.20.193.40:0/2274332075 >> v2:10.20.193.120:6800/397309233 conn(0x7f4114074100 0x7f41140945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa183fff640 1 -- 10.20.193.40:0/361062604 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fa19c01d440 con 0x7fa1a816ada0 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f41437fe640 1 --2- 10.20.193.40:0/2274332075 >> v2:10.20.193.120:6800/397309233 conn(0x7f4114074100 0x7f41140945b0 secure :-1 s=READY pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4130004970 tx=0x7f4130003620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f411ffff640 10 client.4599.objecter ms_handle_connect 0x7f4114074100 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa183fff640 1 --2- 10.20.193.40:0/361062604 >> v2:10.20.193.120:6800/397309233 conn(0x7fa1780741c0 0x7fa178094670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa1a77fe640 1 --2- 10.20.193.40:0/361062604 >> v2:10.20.193.120:6800/397309233 conn(0x7fa1780741c0 0x7fa178094670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f90077fe640 1 -- 10.20.193.40:0/2967685557 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f9010002be0 con 0x7f9028147a60 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa1a77fe640 1 --2- 10.20.193.40:0/361062604 >> v2:10.20.193.120:6800/397309233 conn(0x7fa1780741c0 0x7fa178094670 secure :-1 s=READY pgs=103 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa194002410 tx=0x7fa1940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f90077fe640 1 --2- 10.20.193.40:0/2967685557 >> v2:10.20.193.120:6800/397309233 conn(0x7f8ff4074100 0x7f8ff40945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa183fff640 10 client.4602.objecter ms_handle_connect 0x7fa1780741c0 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa183fff640 1 -- 10.20.193.40:0/361062604 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fa19c019260 con 0x7fa1a816ada0 2026-02-24T17:25:12.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa183fff640 10 client.4602.objecter ms_dispatch2 0x7fa1a8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa183fff640 3 client.4602.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa183fff640 3 client.4602.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f411ffff640 1 -- 10.20.193.40:0/2274332075 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f413412dcf0 con 0x7f41440b55c0 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f411ffff640 10 client.4599.objecter ms_dispatch2 0x7f4144000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f411ffff640 3 client.4599.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f411ffff640 3 client.4599.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f90077fe640 1 -- 10.20.193.40:0/2967685557 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f9010010040 con 0x7f9028147a60 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f90077fe640 10 client.4605.objecter ms_dispatch2 0x7f9028000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f90077fe640 3 client.4605.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f90077fe640 3 client.4605.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7fa183fff640 20 client.4602.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f411ffff640 20 client.4599.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f9026ffd640 1 --2- 10.20.193.40:0/2967685557 >> v2:10.20.193.120:6800/397309233 conn(0x7f8ff4074100 0x7f8ff40945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f90077fe640 20 client.4605.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f90077fe640 10 client.4605.objecter ms_handle_connect 0x7f8ff4074100 2026-02-24T17:25:12.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f9026ffd640 1 --2- 10.20.193.40:0/2967685557 >> v2:10.20.193.120:6800/397309233 conn(0x7f8ff4074100 0x7f8ff40945b0 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901c002b70 tx=0x7f901c002fa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.211+0000 7f54e2ffd640 1 -- 10.20.193.40:0/3289748108 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f54ec0a7070 con 0x7f54fc0b38f0 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f54e2ffd640 1 --2- 10.20.193.40:0/3289748108 >> v2:10.20.193.120:6800/397309233 conn(0x7f54cc074070 0x7f54cc094520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f54e2ffd640 1 -- 10.20.193.40:0/3289748108 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f54ec0bd020 con 0x7f54fc0b38f0 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f54e2ffd640 10 client.4596.objecter ms_dispatch2 0x7f54fc000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f54e2ffd640 3 client.4596.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f54e2ffd640 3 client.4596.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f54e2ffd640 20 client.4596.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f5501911640 1 --2- 10.20.193.40:0/3289748108 >> v2:10.20.193.120:6800/397309233 conn(0x7f54cc074070 0x7f54cc094520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f54e2ffd640 10 client.4596.objecter ms_handle_connect 0x7f54cc074070 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f5501911640 1 --2- 10.20.193.40:0/3289748108 >> v2:10.20.193.120:6800/397309233 conn(0x7f54cc074070 0x7f54cc094520 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54f0002810 tx=0x7f54f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde24f0640 1 Processor -- start 2026-02-24T17:25:12.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde24f0640 1 -- start start 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde24f0640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7efddc16ada0 0x7efddc05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde24f0640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efddc1673c0 con 0x7efddc0bc470 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde24f0640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efddc1676a0 con 0x7efddc05d1a0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde24f0640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7efddc167980 con 0x7efddc16ada0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde0a66640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7efddc0bc470 0x7efddc0b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49314/0 (socket says 10.20.193.40:49314) 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde0a66640 1 -- 10.20.193.40:0/4214735246 learned_addr learned my addr 10.20.193.40:0/4214735246 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddb7fe640 1 --2- 10.20.193.40:0/4214735246 >> v2:10.20.193.109:3300/0 conn(0x7efddc16ada0 0x7efddc05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450156402 0 0) 0x7efddc1676a0 con 0x7efddc05d1a0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdc0003620 con 0x7efddc05d1a0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 <== mon.2 v1:10.20.193.109:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3008183695 0 0) 0x7efdc0003620 con 0x7efddc05d1a0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 >> v2:10.20.193.109:3300/0 conn(0x7efddc16ada0 msgr2=0x7efddc05d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 --2- 10.20.193.40:0/4214735246 >> v2:10.20.193.109:3300/0 conn(0x7efddc16ada0 0x7efddc05d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 >> v1:10.20.193.40:6789/0 conn(0x7efddc0bc470 legacy=0x7efddc0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 --> v1:10.20.193.109:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc0b4430 con 0x7efddc05d1a0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 <== mon.2 v1:10.20.193.109:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7efdc8002e80 con 0x7efddc05d1a0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 >> v1:10.20.193.109:6789/0 conn(0x7efddc05d1a0 legacy=0x7efddc166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efdc0003bf0 0x7efdc0004000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efdc0004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efdc00053a0 0x7efdc006e4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efddc167980 con 0x7efdc00048d0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7efdc006ece0 con 0x7efdc00053a0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7efdc006eee0 con 0x7efdc0003bf0 2026-02-24T17:25:12.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f411ffff640 1 -- 10.20.193.40:0/2274332075 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f41340c4020 con 0x7f41440b55c0 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddb7fe640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efdc0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efde0a66640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efdc00053a0 0x7efdc006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddbfff640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efdc0003bf0 0x7efdc0004000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddb7fe640 1 -- 10.20.193.40:0/4214735246 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efdc0003bf0 msgr2=0x7efdc0004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddb7fe640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efdc0003bf0 0x7efdc0004000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddb7fe640 1 -- 10.20.193.40:0/4214735246 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efdc00053a0 msgr2=0x7efdc006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddb7fe640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efdc00053a0 0x7efdc006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7efddb7fe640 1 -- 10.20.193.40:0/4214735246 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc0003620 con 0x7efdc00048d0 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f32ed4d0640 1 Processor -- start 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.215+0000 7f32ed4d0640 1 -- start start 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f32e805d1a0 0x7f32e805d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7efde0a66640 1 -- 10.20.193.40:0/4214735246 reap_dead start 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f32e816ada0 0x7f32e8166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e8167130 con 0x7f32e80bc470 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f32e81673c0 con 0x7f32e805d1a0 2026-02-24T17:25:12.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f32e81676a0 con 0x7f32e816ada0 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e6ffd640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f32e805d1a0 0x7f32e805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e67fc640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f32e816ada0 0x7f32e8166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e6ffd640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f32e805d1a0 0x7f32e805d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:54304/0 (socket says 10.20.193.40:54304) 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e6ffd640 1 -- 10.20.193.40:0/4107445594 learned_addr learned my addr 10.20.193.40:0/4107445594 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e67fc640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f32e816ada0 0x7f32e8166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:57854/0 (socket says 10.20.193.40:57854) 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e77fe640 1 --1- 10.20.193.40:0/4107445594 >> v1:10.20.193.94:6789/0 conn(0x7f32e80bc470 0x7f32e80b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:50196/0 (socket says 10.20.193.40:50196) 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7efddb7fe640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efdc0004d40 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=3145631257346299605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdcc009af0 tx=0x7efdcc01cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba786f6587dd6d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e67fc640 1 -- 10.20.193.40:0/4107445594 >> v2:10.20.193.94:3300/0 conn(0x7f32e805d1a0 msgr2=0x7f32e805d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e67fc640 1 --2- 10.20.193.40:0/4107445594 >> v2:10.20.193.94:3300/0 conn(0x7f32e805d1a0 0x7f32e805d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e67fc640 1 -- 10.20.193.40:0/4107445594 >> v1:10.20.193.94:6789/0 conn(0x7f32e80bc470 legacy=0x7f32e80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e67fc640 1 -- 10.20.193.40:0/4107445594 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e8167980 con 0x7f32e816ada0 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fa183fff640 1 -- 10.20.193.40:0/361062604 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fa19c022070 con 0x7fa1a816ada0 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc638d4640 1 Processor -- start 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc638d4640 1 -- start start 2026-02-24T17:25:12.267 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e67fc640 1 --2- 10.20.193.40:0/4107445594 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e816ada0 0x7f32e8166bf0 secure :-1 s=READY pgs=101 gs=3 cs=0 l=1 c_cookie=7223943131547088478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32e8161140 tx=0x7f32d001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64409a01097cb65e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e5ffb640 1 -- 10.20.193.40:0/4107445594 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32d00aa450 con 0x7f32e816ada0 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e5ffb640 1 -- 10.20.193.40:0/4107445594 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d00af070 con 0x7f32e816ada0 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32e5ffb640 1 -- 10.20.193.40:0/4107445594 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32d00aa830 con 0x7f32e816ada0 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc638d4640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fcc5c05d1a0 0x7fcc5c05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc638d4640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fcc5c16ada0 0x7fcc5c166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc638d4640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5c167130 con 0x7fcc5c0bc470 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc638d4640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fcc5c1673c0 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- 10.20.193.40:0/4107445594 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e816ada0 msgr2=0x7f32e8166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/4107445594 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e816ada0 0x7f32e8166bf0 secure :-1 s=READY pgs=101 gs=3 cs=0 l=1 c_cookie=7223943131547088478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32e8161140 tx=0x7f32d001c4f0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc638d4640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fcc5c1676a0 con 0x7fcc5c16ada0 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc61649640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fcc5c05d1a0 0x7fcc5c05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- 10.20.193.40:0/4107445594 shutdown_connections 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/4107445594 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e816ada0 0x7f32e8166bf0 unknown :-1 s=CLOSED pgs=101 gs=3 cs=0 l=1 c_cookie=7223943131547088478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/4107445594 >> v2:10.20.193.94:3300/0 conn(0x7f32e805d1a0 0x7f32e805d570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.268 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- 10.20.193.40:0/4107445594 >> 10.20.193.40:0/4107445594 conn(0x7f32e80bd200 msgr2=0x7f32e80bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc61649640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fcc5c05d1a0 0x7fcc5c05d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60200/0 (socket says 10.20.193.40:60200) 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc61649640 1 -- 10.20.193.40:0/2999382208 learned_addr learned my addr 10.20.193.40:0/2999382208 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc60e48640 1 --2- 10.20.193.40:0/2999382208 >> v2:10.20.193.94:3300/0 conn(0x7fcc5c16ada0 0x7fcc5c166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- 10.20.193.40:0/4107445594 shutdown_connections 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- 10.20.193.40:0/4107445594 wait complete. 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc61649640 1 -- 10.20.193.40:0/2999382208 >> v2:10.20.193.94:3300/0 conn(0x7fcc5c16ada0 msgr2=0x7fcc5c166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc61649640 1 --2- 10.20.193.40:0/2999382208 >> v2:10.20.193.94:3300/0 conn(0x7fcc5c16ada0 0x7fcc5c166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc61649640 1 -- 10.20.193.40:0/2999382208 >> v1:10.20.193.109:6789/0 conn(0x7fcc5c0bc470 legacy=0x7fcc5c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7fcc61649640 1 -- 10.20.193.40:0/2999382208 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c167980 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 librados: starting msgr at 2026-02-24T17:25:12.269 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 librados: starting objecter 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 Processor -- start 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 -- start start 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 librados: setting wanted keys 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.219+0000 7f32ed4d0640 1 librados: calling monclient init 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e805d1a0 0x7f32e81689b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32e80bc470 0x7f32e8131d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f32e816ada0 0x7f32e8126660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f32e815d9e0 con 0x7f32e80bc470 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f32e815d860 con 0x7f32e816ada0 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f32e81cd510 con 0x7f32e805d1a0 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32e80bc470 0x7f32e8131d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32e80bc470 0x7f32e8131d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60202/0 (socket says 10.20.193.40:60202) 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 -- 10.20.193.40:0/303398851 learned_addr learned my addr 10.20.193.40:0/303398851 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e6ffd640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e805d1a0 0x7f32e81689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e77fe640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f32e816ada0 0x7f32e8126660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7fcc61649640 1 --2- 10.20.193.40:0/2999382208 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c05d570 secure :-1 s=READY pgs=171 gs=2 cs=0 l=1 c_cookie=893540445395761057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc5c161140 tx=0x7fcc4c01c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c667e4d084237a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 -- 10.20.193.40:0/303398851 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e805d1a0 msgr2=0x7f32e81689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e805d1a0 0x7f32e81689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 -- 10.20.193.40:0/303398851 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f32e816ada0 msgr2=0x7f32e8126660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f32e816ada0 0x7f32e8126660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 -- 10.20.193.40:0/303398851 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e8168ef0 con 0x7f32e80bc470 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7fcc4bfff640 1 -- 10.20.193.40:0/2999382208 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc4c0a9670 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.270 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdcc0b2070 con 0x7efdc00048d0 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32e67fc640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32e80bc470 0x7f32e8131d80 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d001ca60 tx=0x7f32d0019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32c77fe640 10 client.?.objecter ms_handle_connect 0x7f32e80bc470 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f90077fe640 1 -- 10.20.193.40:0/2967685557 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f9010060d00 con 0x7f9028147a60 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc0a5820 con 0x7efdc00048d0 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7efddaffd640 1 -- 10.20.193.40:0/4214735246 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdcc0096f0 con 0x7efdc00048d0 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32c77fe640 1 -- 10.20.193.40:0/303398851 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32d00b8020 con 0x7f32e80bc470 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7fcc4bfff640 1 -- 10.20.193.40:0/2999382208 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4c0a9810 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7fcc4bfff640 1 -- 10.20.193.40:0/2999382208 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc4c0a9c00 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32c77fe640 1 -- 10.20.193.40:0/303398851 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d00a6040 con 0x7f32e80bc470 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32c77fe640 1 -- 10.20.193.40:0/303398851 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32d00aa450 con 0x7f32e80bc470 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e81322c0 con 0x7f32e80bc470 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 10 client.4611.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e8169180 con 0x7f32e80bc470 2026-02-24T17:25:12.271 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.223+0000 7f32ed4d0640 1 librados: init done 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f54e2ffd640 1 -- 10.20.193.40:0/3289748108 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f54ec0ac030 con 0x7f54fc0b38f0 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2999382208 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 msgr2=0x7fcc5c05d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 --2- 10.20.193.40:0/2999382208 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c05d570 secure :-1 s=READY pgs=171 gs=2 cs=0 l=1 c_cookie=893540445395761057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc5c161140 tx=0x7fcc4c01c5d0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- 10.20.193.40:0/4214735246 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 msgr2=0x7efdc0004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efdc0004d40 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=3145631257346299605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdcc009af0 tx=0x7efdcc01cb50 comp rx=0 tx=0).stop 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2999382208 shutdown_connections 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 --2- 10.20.193.40:0/2999382208 >> v2:10.20.193.94:3300/0 conn(0x7fcc5c16ada0 0x7fcc5c166bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 --2- 10.20.193.40:0/2999382208 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c05d570 unknown :-1 s=CLOSED pgs=171 gs=2 cs=0 l=1 c_cookie=893540445395761057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2999382208 >> 10.20.193.40:0/2999382208 conn(0x7fcc5c0bd200 msgr2=0x7fcc5c0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- 10.20.193.40:0/4214735246 shutdown_connections 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 --2- 10.20.193.40:0/4214735246 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efdc0004d40 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=3145631257346299605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- 10.20.193.40:0/4214735246 >> 10.20.193.40:0/4214735246 conn(0x7efddc0bd200 msgr2=0x7efddc0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- 10.20.193.40:0/4214735246 shutdown_connections 2026-02-24T17:25:12.272 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2999382208 shutdown_connections 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- 10.20.193.40:0/4214735246 wait complete. 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2999382208 wait complete. 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e8166bf0 con 0x7f32e80bc470 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 librados: starting msgr at 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 librados: starting objecter 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 Processor -- start 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 1 -- 10.20.193.40:0/303398851 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f32d00aa5f0 con 0x7f32e80bc470 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- start start 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 librados: setting wanted keys 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 librados: calling monclient init 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bf010640 1 Processor -- start 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 librados: starting msgr at 2026-02-24T17:25:12.273 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 librados: starting objecter 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bf010640 1 -- start start 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 Processor -- start 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- start start 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 1 --2- 10.20.193.40:0/303398851 >> v2:10.20.193.120:6800/397309233 conn(0x7f32b40741d0 0x7f32b4094680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 librados: setting wanted keys 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 librados: calling monclient init 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efddc168770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efddc168cb0 0x7efddc1f8b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efddc165d20 0x7efddc1f9090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7efddc0bc840 con 0x7efdc00048d0 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7efddc0b49f0 con 0x7efddc168cb0 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7efddc0bc9c0 con 0x7efddc165d20 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 1 -- 10.20.193.40:0/303398851 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f32d0130520 con 0x7f32e80bc470 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 10 client.4611.objecter ms_dispatch2 0x7f32e8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.274 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32e6ffd640 1 --2- 10.20.193.40:0/303398851 >> v2:10.20.193.120:6800/397309233 conn(0x7f32b40741d0 0x7f32b4094680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 3 client.4611.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 3 client.4611.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 20 client.4611.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efddc168770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efddc168770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60212/0 (socket says 10.20.193.40:60212) 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 -- 10.20.193.40:0/2548016837 learned_addr learned my addr 10.20.193.40:0/2548016837 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddb7fe640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efddc168cb0 0x7efddc1f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde0a66640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efddc165d20 0x7efddc1f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c1698d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bf010640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f55b805d1a0 0x7f55b805d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 -- 10.20.193.40:0/2548016837 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efddc165d20 msgr2=0x7efddc1f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efddc165d20 0x7efddc1f9090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcc5c0bc470 0x7fcc5c123df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 -- 10.20.193.40:0/2548016837 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efddc168cb0 msgr2=0x7efddc1f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efddc168cb0 0x7efddc1f8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.275 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 -- 10.20.193.40:0/2548016837 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc166230 con 0x7efdc00048d0 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcc5c16ada0 0x7fcc5c124330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c1698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c1698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60224/0 (socket says 10.20.193.40:60224) 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 -- 10.20.193.40:0/2995899048 learned_addr learned my addr 10.20.193.40:0/2995899048 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2995899048 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c15d9e0 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2995899048 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c15d860 con 0x7fcc5c0bc470 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2995899048 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c1cd510 con 0x7fcc5c16ada0 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bf010640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b81673c0 con 0x7f55b80bc470 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efddbfff640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efddc168770 secure :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdc80034d0 tx=0x7efdc80105b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efdd8ff9640 10 client.?.objecter ms_handle_connect 0x7efdc00048d0 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efdd8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bf010640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b81676a0 con 0x7f55b816ada0 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 10 client.4611.objecter ms_handle_connect 0x7f32b40741d0 2026-02-24T17:25:12.276 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32e6ffd640 1 --2- 10.20.193.40:0/303398851 >> v2:10.20.193.120:6800/397309233 conn(0x7f32b40741d0 0x7f32b4094680 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32dc004780 tx=0x7f32dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc60e48640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcc5c0bc470 0x7fcc5c123df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bd586640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f55b80bc470 0x7f55b80b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49330/0 (socket says 10.20.193.40:49330) 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bf010640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f55b8167980 con 0x7f55b805d1a0 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bd586640 1 -- 10.20.193.40:0/1212117383 learned_addr learned my addr 10.20.193.40:0/1212117383 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61e4a640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcc5c16ada0 0x7fcc5c124330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bcd85640 1 --2- 10.20.193.40:0/1212117383 >> v2:10.20.193.109:3300/0 conn(0x7f55b805d1a0 0x7f55b805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 -- 10.20.193.40:0/2995899048 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcc5c16ada0 msgr2=0x7fcc5c124330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcc5c16ada0 0x7fcc5c124330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 -- 10.20.193.40:0/2995899048 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcc5c0bc470 msgr2=0x7fcc5c123df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcc5c0bc470 0x7fcc5c123df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 -- 10.20.193.40:0/2995899048 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c169e10 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61e4a640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcc5c16ada0 0x7fcc5c124330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc61649640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c1698d0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc4c004780 tx=0x7fcc4c019370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc49ffb640 10 client.?.objecter ms_handle_connect 0x7fcc5c05d1a0 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc49ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.277 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bcd85640 1 -- 10.20.193.40:0/1212117383 >> v1:10.20.193.94:6789/0 conn(0x7f55b816ada0 legacy=0x7f55b8166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bcd85640 1 -- 10.20.193.40:0/1212117383 >> v1:10.20.193.40:6789/0 conn(0x7f55b80bc470 legacy=0x7f55b80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f55bcd85640 1 -- 10.20.193.40:0/1212117383 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b80b4430 con 0x7f55b805d1a0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efdd8ff9640 1 -- 10.20.193.40:0/2548016837 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdc801b070 con 0x7efdc00048d0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efdd8ff9640 1 -- 10.20.193.40:0/2548016837 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8005560 con 0x7efdc00048d0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efdd8ff9640 1 -- 10.20.193.40:0/2548016837 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdc8006b30 con 0x7efdc00048d0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc49ffb640 1 -- 10.20.193.40:0/2995899048 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc4c0a9e60 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc49ffb640 1 -- 10.20.193.40:0/2995899048 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4c004020 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc49ffb640 1 -- 10.20.193.40:0/2995899048 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc4c004410 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efddc166510 con 0x7efdc00048d0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 10 client.4614.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efddc166ad0 con 0x7efdc00048d0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7efde24f0640 1 librados: init done 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7f32c77fe640 1 -- 10.20.193.40:0/303398851 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f32d00c2020 con 0x7f32e80bc470 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2995899048 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5c1cb2d0 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 10 client.4617.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 -- 10.20.193.40:0/2995899048 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5c168830 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.278 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.227+0000 7fcc638d4640 1 librados: init done 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efddc166d10 con 0x7efdc00048d0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc2b7fe640 1 -- 10.20.193.40:0/2995899048 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc18005130 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bcd85640 1 --2- 10.20.193.40:0/1212117383 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b805d1a0 0x7f55b805d570 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=4088122929738449712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55a8004780 tx=0x7f55a801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38bbee2511308330 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55af7fe640 1 -- 10.20.193.40:0/1212117383 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55a80a9610 con 0x7f55b805d1a0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55af7fe640 1 -- 10.20.193.40:0/1212117383 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a80a97b0 con 0x7f55b805d1a0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55af7fe640 1 -- 10.20.193.40:0/1212117383 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55a80a9ba0 con 0x7f55b805d1a0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 1 -- 10.20.193.40:0/2548016837 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7efdc8006cd0 con 0x7efdc00048d0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc49ffb640 1 -- 10.20.193.40:0/2995899048 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fcc4c0b9030 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 1 --2- 10.20.193.40:0/2548016837 >> v2:10.20.193.120:6800/397309233 conn(0x7efdac0740f0 0x7efdac0945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- 10.20.193.40:0/1212117383 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b805d1a0 msgr2=0x7f55b805d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 --2- 10.20.193.40:0/1212117383 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b805d1a0 0x7f55b805d570 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=4088122929738449712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55a8004780 tx=0x7f55a801c530 comp rx=0 tx=0).stop 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 1 -- 10.20.193.40:0/2548016837 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7efdc8098320 con 0x7efdc00048d0 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 10 client.4614.objecter ms_dispatch2 0x7efddc000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.279 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 3 client.4614.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 3 client.4614.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- 10.20.193.40:0/1212117383 shutdown_connections 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 --2- 10.20.193.40:0/1212117383 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b805d1a0 0x7f55b805d570 unknown :-1 s=CLOSED pgs=103 gs=2 cs=0 l=1 c_cookie=4088122929738449712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- 10.20.193.40:0/1212117383 >> 10.20.193.40:0/1212117383 conn(0x7f55b80bd200 msgr2=0x7f55b80bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 20 client.4614.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- 10.20.193.40:0/1212117383 shutdown_connections 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- 10.20.193.40:0/1212117383 wait complete. 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efddb7fe640 1 --2- 10.20.193.40:0/2548016837 >> v2:10.20.193.120:6800/397309233 conn(0x7efdac0740f0 0x7efdac0945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc49ffb640 1 --2- 10.20.193.40:0/2995899048 >> v2:10.20.193.120:6800/397309233 conn(0x7fcc2c074100 0x7fcc2c0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc49ffb640 1 -- 10.20.193.40:0/2995899048 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fcc4c12fb80 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc49ffb640 10 client.4617.objecter ms_dispatch2 0x7fcc5c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc49ffb640 3 client.4617.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc49ffb640 3 client.4617.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc49ffb640 20 client.4617.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc60e48640 1 --2- 10.20.193.40:0/2995899048 >> v2:10.20.193.120:6800/397309233 conn(0x7fcc2c074100 0x7fcc2c0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 librados: starting msgr at 2026-02-24T17:25:12.280 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 librados: starting objecter 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efddb7fe640 1 --2- 10.20.193.40:0/2548016837 >> v2:10.20.193.120:6800/397309233 conn(0x7efdac0740f0 0x7efdac0945a0 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdcc01c980 tx=0x7efdcc0047b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 10 client.4614.objecter ms_handle_connect 0x7efdac0740f0 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 Processor -- start 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- start start 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 librados: setting wanted keys 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 librados: calling monclient init 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc60e48640 1 --2- 10.20.193.40:0/2995899048 >> v2:10.20.193.120:6800/397309233 conn(0x7fcc2c074100 0x7fcc2c0945b0 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc5c164570 tx=0x7fcc50009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7fcc49ffb640 10 client.4617.objecter ms_handle_connect 0x7fcc2c074100 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f55b805d1a0 0x7f55b8158650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f55b80bc470 0x7f55b8162840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b816ada0 0x7f55b8161470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81ce520 con 0x7f55b80bc470 2026-02-24T17:25:12.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f55b815da70 con 0x7f55b805d1a0 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bf010640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81ce6a0 con 0x7f55b816ada0 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f55b80bc470 0x7f55b8162840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f55b80bc470 0x7f55b8162840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60226/0 (socket says 10.20.193.40:60226) 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 -- 10.20.193.40:0/4122025267 learned_addr learned my addr 10.20.193.40:0/4122025267 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bcd85640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f55b805d1a0 0x7f55b8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55bd586640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b816ada0 0x7f55b8161470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 -- 10.20.193.40:0/4122025267 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b816ada0 msgr2=0x7f55b8161470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b816ada0 0x7f55b8161470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 -- 10.20.193.40:0/4122025267 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f55b805d1a0 msgr2=0x7f55b8158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f55b805d1a0 0x7f55b8158650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 -- 10.20.193.40:0/4122025267 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b8162eb0 con 0x7f55b80bc470 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55affff640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f55b80bc470 0x7f55b8162840 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55a000c550 tx=0x7f55a000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55ad7fa640 10 client.?.objecter ms_handle_connect 0x7f55b80bc470 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7f55ad7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.231+0000 7efdd8ff9640 1 -- 10.20.193.40:0/2548016837 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7efddc166d10 con 0x7efdc00048d0 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7f55ad7fa640 1 -- 10.20.193.40:0/4122025267 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55a0006af0 con 0x7f55b80bc470 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7f55ad7fa640 1 -- 10.20.193.40:0/4122025267 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a0006c90 con 0x7f55b80bc470 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7f55ad7fa640 1 -- 10.20.193.40:0/4122025267 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55a0007270 con 0x7f55b80bc470 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b8168310 con 0x7f55b80bc470 2026-02-24T17:25:12.282 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7fcc49ffb640 1 -- 10.20.193.40:0/2995899048 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fcc4c0c1030 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7f55bf010640 10 client.4620.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b81688d0 con 0x7f55b80bc470 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7f55bf010640 1 librados: init done 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.235+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b805d570 con 0x7f55b80bc470 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 1 -- 10.20.193.40:0/4122025267 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f55a0023060 con 0x7f55b80bc470 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 1 --2- 10.20.193.40:0/4122025267 >> v2:10.20.193.120:6800/397309233 conn(0x7f5588074250 0x7f5588094700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 1 -- 10.20.193.40:0/4122025267 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f55a0095cf0 con 0x7f55b80bc470 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 10 client.4620.objecter ms_dispatch2 0x7f55b8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 3 client.4620.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 3 client.4620.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55bcd85640 1 --2- 10.20.193.40:0/4122025267 >> v2:10.20.193.120:6800/397309233 conn(0x7f5588074250 0x7f5588094700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 20 client.4620.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 10 client.4620.objecter ms_handle_connect 0x7f5588074250 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55bcd85640 1 --2- 10.20.193.40:0/4122025267 >> v2:10.20.193.120:6800/397309233 conn(0x7f5588074250 0x7f5588094700 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55a801c570 tx=0x7f55a80b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.283 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.239+0000 7f55ad7fa640 1 -- 10.20.193.40:0/4122025267 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f55a005fbf0 con 0x7f55b80bc470 2026-02-24T17:25:12.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f9171cb9640 1 Processor -- start 2026-02-24T17:25:12.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f9171cb9640 1 -- start start 2026-02-24T17:25:12.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f9171cb9640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f916c16ada0 0x7f916c05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f9171cb9640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f916c1673c0 con 0x7f916c05d1a0 2026-02-24T17:25:12.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f9171cb9640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f916c1676a0 con 0x7f916c0bc470 2026-02-24T17:25:12.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f9171cb9640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f916c167980 con 0x7f916c16ada0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f916affd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f916c16ada0 0x7f916c05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f916affd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f916c16ada0 0x7f916c05d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60234/0 (socket says 10.20.193.40:60234) 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f916b7fe640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f916c05d1a0 0x7f916c166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49342/0 (socket says 10.20.193.40:49342) 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.267+0000 7f916affd640 1 -- 10.20.193.40:0/429259943 learned_addr learned my addr 10.20.193.40:0/429259943 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 -- 10.20.193.40:0/429259943 >> v1:10.20.193.94:6789/0 conn(0x7f916c0bc470 legacy=0x7f916c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 -- 10.20.193.40:0/429259943 >> v1:10.20.193.40:6789/0 conn(0x7f916c05d1a0 legacy=0x7f916c166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 -- 10.20.193.40:0/429259943 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c0b4430 con 0x7f916c16ada0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 --2- 10.20.193.40:0/429259943 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c16ada0 0x7f916c05d570 secure :-1 s=READY pgs=178 gs=3 cs=0 l=1 c_cookie=3511248904663136553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915c0090a0 tx=0x7f915c01c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ba7646806cf929 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916a7fc640 1 -- 10.20.193.40:0/429259943 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915c0a8630 con 0x7f916c16ada0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916a7fc640 1 -- 10.20.193.40:0/429259943 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915c0a87d0 con 0x7f916c16ada0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916a7fc640 1 -- 10.20.193.40:0/429259943 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915c0a8bc0 con 0x7f916c16ada0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- 10.20.193.40:0/429259943 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c16ada0 msgr2=0x7f916c05d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 --2- 10.20.193.40:0/429259943 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c16ada0 0x7f916c05d570 secure :-1 s=READY pgs=178 gs=3 cs=0 l=1 c_cookie=3511248904663136553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915c0090a0 tx=0x7f915c01c5f0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- 10.20.193.40:0/429259943 shutdown_connections 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 --2- 10.20.193.40:0/429259943 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c16ada0 0x7f916c05d570 unknown :-1 s=CLOSED pgs=178 gs=3 cs=0 l=1 c_cookie=3511248904663136553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- 10.20.193.40:0/429259943 >> 10.20.193.40:0/429259943 conn(0x7f916c0bd200 msgr2=0x7f916c0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- 10.20.193.40:0/429259943 shutdown_connections 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- 10.20.193.40:0/429259943 wait complete. 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 librados: starting msgr at 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 librados: starting objecter 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 Processor -- start 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- start start 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 librados: setting wanted keys 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 librados: calling monclient init 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f916c05d1a0 0x7f916c13ecc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c0bc470 0x7f916c120f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f916c16ada0 0x7f916c11e6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1ce520 con 0x7f916c0bc470 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f916c15da70 con 0x7f916c05d1a0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1ce6a0 con 0x7f916c16ada0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c0bc470 0x7f916c120f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c0bc470 0x7f916c120f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60236/0 (socket says 10.20.193.40:60236) 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 -- 10.20.193.40:0/2369481106 learned_addr learned my addr 10.20.193.40:0/2369481106 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916bfff640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f916c16ada0 0x7f916c11e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916b7fe640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f916c05d1a0 0x7f916c13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 -- 10.20.193.40:0/2369481106 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f916c16ada0 msgr2=0x7f916c11e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f916c16ada0 0x7f916c11e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 -- 10.20.193.40:0/2369481106 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f916c05d1a0 msgr2=0x7f916c13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f916c05d1a0 0x7f916c13ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 -- 10.20.193.40:0/2369481106 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c122920 con 0x7f916c0bc470 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f916affd640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c0bc470 0x7f916c120f50 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915c01cb60 tx=0x7f915c01ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9147fff640 10 client.?.objecter ms_handle_connect 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9147fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9147fff640 1 -- 10.20.193.40:0/2369481106 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915c004240 con 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9147fff640 1 -- 10.20.193.40:0/2369481106 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915c0043e0 con 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9147fff640 1 -- 10.20.193.40:0/2369481106 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915c003970 con 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c122c00 con 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 10 client.4629.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c1231c0 con 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.271+0000 7f9171cb9640 1 librados: init done 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916c05d570 con 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 1 -- 10.20.193.40:0/2369481106 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f915c0a7070 con 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 1 --2- 10.20.193.40:0/2369481106 >> v2:10.20.193.120:6800/397309233 conn(0x7f913c0740f0 0x7f913c0945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 1 -- 10.20.193.40:0/2369481106 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f915c0bd020 con 0x7f916c0bc470 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 10 client.4629.objecter ms_dispatch2 0x7f916c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 3 client.4629.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 3 client.4629.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 20 client.4629.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f916b7fe640 1 --2- 10.20.193.40:0/2369481106 >> v2:10.20.193.120:6800/397309233 conn(0x7f913c0740f0 0x7f913c0945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 10 client.4629.objecter ms_handle_connect 0x7f913c0740f0 2026-02-24T17:25:12.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f916b7fe640 1 --2- 10.20.193.40:0/2369481106 >> v2:10.20.193.120:6800/397309233 conn(0x7f913c0740f0 0x7f913c0945a0 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9158002770 tx=0x7f9158007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.287 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.275+0000 7f9147fff640 1 -- 10.20.193.40:0/2369481106 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f915c0ac030 con 0x7f916c0bc470 2026-02-24T17:25:12.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.283+0000 7fe96a28c640 1 Processor -- start 2026-02-24T17:25:12.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.283+0000 7fe96a28c640 1 -- start start 2026-02-24T17:25:12.294 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.283+0000 7fe96a28c640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fe96405d1a0 0x7fe96405d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.283+0000 7fe96a28c640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9641673c0 con 0x7fe96416ada0 2026-02-24T17:25:12.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.283+0000 7fe96a28c640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9641676a0 con 0x7fe9640bc470 2026-02-24T17:25:12.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.283+0000 7fe96a28c640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fe964167980 con 0x7fe96405d1a0 2026-02-24T17:25:12.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.283+0000 7fe9637fe640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fe96416ada0 0x7fe964166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49354/0 (socket says 10.20.193.40:49354) 2026-02-24T17:25:12.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.283+0000 7fe9637fe640 1 -- 10.20.193.40:0/870042350 learned_addr learned my addr 10.20.193.40:0/870042350 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe963fff640 1 --2- 10.20.193.40:0/870042350 >> v2:10.20.193.109:3300/0 conn(0x7fe96405d1a0 0x7fe96405d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.295 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858831578 0 0) 0x7fe9641673c0 con 0x7fe96416ada0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe948003620 con 0x7fe96416ada0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 115801571 0 0) 0x7fe9641676a0 con 0x7fe9640bc470 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9641673c0 con 0x7fe9640bc470 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 800255627 0 0) 0x7fe948003620 con 0x7fe96416ada0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 >> v2:10.20.193.109:3300/0 conn(0x7fe96405d1a0 msgr2=0x7fe96405d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 --2- 10.20.193.40:0/870042350 >> v2:10.20.193.109:3300/0 conn(0x7fe96405d1a0 0x7fe96405d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 >> v1:10.20.193.109:6789/0 conn(0x7fe9640bc470 legacy=0x7fe9640b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9640b4430 con 0x7fe96416ada0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7fe954002e80 con 0x7fe96416ada0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 >> v1:10.20.193.40:6789/0 conn(0x7fe96416ada0 legacy=0x7fe964166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe948003dd0 0x7fe9480041c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9480048d0 0x7fe948004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948005340 0x7fe948065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe964167980 con 0x7fe948003dd0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe948066280 con 0x7fe9480048d0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fe948066480 con 0x7fe948005340 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe963fff640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe948003dd0 0x7fe9480041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe968802640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948005340 0x7fe948065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe9637fe640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9480048d0 0x7fe948004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe963fff640 1 -- 10.20.193.40:0/870042350 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948005340 msgr2=0x7fe948065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe963fff640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948005340 0x7fe948065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe963fff640 1 -- 10.20.193.40:0/870042350 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9480048d0 msgr2=0x7fe948004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe963fff640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9480048d0 0x7fe948004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe963fff640 1 -- 10.20.193.40:0/870042350 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe948003620 con 0x7fe948003dd0 2026-02-24T17:25:12.296 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe968802640 1 -- 10.20.193.40:0/870042350 reap_dead start 2026-02-24T17:25:12.297 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe963fff640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe948003dd0 0x7fe9480041c0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=4137015890752581579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe950009af0 tx=0x7fe95001cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3969a208a6742fcb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9500b2070 con 0x7fe948003dd0 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9500a57f0 con 0x7fe948003dd0 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe962ffd640 1 -- 10.20.193.40:0/870042350 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9500096f0 con 0x7fe948003dd0 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe96a28c640 1 -- 10.20.193.40:0/870042350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe948003dd0 msgr2=0x7fe9480041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe96a28c640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe948003dd0 0x7fe9480041c0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=4137015890752581579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe950009af0 tx=0x7fe95001cae0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe96a28c640 1 -- 10.20.193.40:0/870042350 shutdown_connections 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe96a28c640 1 --2- 10.20.193.40:0/870042350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe948003dd0 0x7fe9480041c0 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=4137015890752581579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe96a28c640 1 -- 10.20.193.40:0/870042350 >> 10.20.193.40:0/870042350 conn(0x7fe9640bd200 msgr2=0x7fe9640bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe96a28c640 1 -- 10.20.193.40:0/870042350 shutdown_connections 2026-02-24T17:25:12.298 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.287+0000 7fe96a28c640 1 -- 10.20.193.40:0/870042350 wait complete. 2026-02-24T17:25:12.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 librados: starting msgr at 2026-02-24T17:25:12.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 librados: starting objecter 2026-02-24T17:25:12.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 Processor -- start 2026-02-24T17:25:12.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 -- start start 2026-02-24T17:25:12.299 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 librados: setting wanted keys 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 librados: calling monclient init 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948003dd0 0x7fe96411e9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe96413d250 0x7fe964165f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9641664c0 0x7fe964122280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe964166bf0 con 0x7fe96413d250 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fe9640b5930 con 0x7fe9641664c0 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fe964166d70 con 0x7fe948003dd0 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe96413d250 0x7fe964165f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe96413d250 0x7fe964165f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60248/0 (socket says 10.20.193.40:60248) 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 -- 10.20.193.40:0/3616068750 learned_addr learned my addr 10.20.193.40:0/3616068750 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe963fff640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948003dd0 0x7fe96411e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.300 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe968802640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9641664c0 0x7fe964122280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 -- 10.20.193.40:0/3616068750 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948003dd0 msgr2=0x7fe96411e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948003dd0 0x7fe96411e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 -- 10.20.193.40:0/3616068750 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9641664c0 msgr2=0x7fe964122280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9641664c0 0x7fe964122280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 -- 10.20.193.40:0/3616068750 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96413c7b0 con 0x7fe96413d250 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe9637fe640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe96413d250 0x7fe964165f80 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9540027c0 tx=0x7fe95400e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe960ff9640 10 client.?.objecter ms_handle_connect 0x7fe96413d250 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe960ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe960ff9640 1 -- 10.20.193.40:0/3616068750 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe954019070 con 0x7fe96413d250 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe960ff9640 1 -- 10.20.193.40:0/3616068750 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9540117d0 con 0x7fe96413d250 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe960ff9640 1 -- 10.20.193.40:0/3616068750 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe954011ba0 con 0x7fe96413d250 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe96411f180 con 0x7fe96413d250 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 10 client.4635.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe96411f740 con 0x7fe96413d250 2026-02-24T17:25:12.301 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 librados: init done 2026-02-24T17:25:12.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe964167100 con 0x7fe96413d250 2026-02-24T17:25:12.302 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f04180626d0 con 0x7f041805b3d0 2026-02-24T17:25:12.303 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.291+0000 7f03feffd640 1 -- 10.20.193.40:0/4238536184 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f040c0f9b10 con 0x7f041805b3d0 2026-02-24T17:25:12.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f319911e640 1 Processor -- start 2026-02-24T17:25:12.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f319911e640 1 -- start start 2026-02-24T17:25:12.303 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7fe960ff9640 1 -- 10.20.193.40:0/3616068750 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fe954011d40 con 0x7fe96413d250 2026-02-24T17:25:12.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f319911e640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f31941597f0 0x7f3194058c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f319911e640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f3194159bc0 0x7f3194162ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f319911e640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3194056fe0 con 0x7f3194163420 2026-02-24T17:25:12.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f319911e640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f31940572c0 con 0x7f31941597f0 2026-02-24T17:25:12.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f319911e640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f3194166460 con 0x7f3194159bc0 2026-02-24T17:25:12.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3192575640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f3194159bc0 0x7f3194162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3193577640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7f3194163420 0x7f31940598e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.40:48106/0 (socket says 10.20.193.40:48106) 2026-02-24T17:25:12.304 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3193577640 1 -- 10.20.193.40:0/3194999094 learned_addr learned my addr 10.20.193.40:0/3194999094 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3192575640 1 -- 10.20.193.40:0/3194999094 >> v2:10.20.193.40:3300/0 conn(0x7f31941597f0 msgr2=0x7f3194058c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3192575640 1 --2- 10.20.193.40:0/3194999094 >> v2:10.20.193.40:3300/0 conn(0x7f31941597f0 0x7f3194058c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3192575640 1 -- 10.20.193.40:0/3194999094 >> v1:10.20.193.109:6789/0 conn(0x7f3194163420 legacy=0x7f31940598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3192575640 1 -- 10.20.193.40:0/3194999094 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941666b0 con 0x7f3194159bc0 2026-02-24T17:25:12.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f041c829640 10 librados: watch_flush enter 2026-02-24T17:25:12.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f041c829640 10 librados: watch_flush exit 2026-02-24T17:25:12.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f041c829640 20 client.4528.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.305 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f041c829640 10 client.4528.objecter successfully canceled tick 2026-02-24T17:25:12.306 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3192575640 1 --2- 10.20.193.40:0/3194999094 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3194159bc0 0x7f3194162ee0 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=1781886140882890318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3194160a60 tx=0x7f317c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18ba880119842e4e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3191d74640 1 -- 10.20.193.40:0/3194999094 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f317c0b0070 con 0x7f3194159bc0 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 >> v2:10.20.193.120:6800/397309233 conn(0x7f03e4074070 msgr2=0x7f03e4094520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f041c829640 1 --2- 10.20.193.40:0/4238536184 >> v2:10.20.193.120:6800/397309233 conn(0x7f03e4074070 0x7f03e4094520 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0418128f10 tx=0x7f04000026e0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f041805b3d0 msgr2=0x7f041812fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f041805b3d0 0x7f041812fb40 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040c01a160 tx=0x7f040c0192d0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3191d74640 1 -- 10.20.193.40:0/3194999094 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c0ab620 con 0x7f3194159bc0 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.295+0000 7f3191d74640 1 -- 10.20.193.40:0/3194999094 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f317c0aba10 con 0x7f3194159bc0 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 shutdown_connections 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 --2- 10.20.193.40:0/4238536184 >> v2:10.20.193.120:6800/397309233 conn(0x7f03e4074070 0x7f03e4094520 unknown :-1 s=CLOSED pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04181650e0 0x7f041812e6e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f041815b050 0x7f04180ae1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 --2- 10.20.193.40:0/4238536184 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f041805b3d0 0x7f041812fb40 unknown :-1 s=CLOSED pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 >> 10.20.193.40:0/4238536184 conn(0x7f04180bafd0 msgr2=0x7f0418166b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 shutdown_connections 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 -- 10.20.193.40:0/4238536184 wait complete. 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f041c829640 1 librados: shutdown 2026-02-24T17:25:12.307 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe960ff9640 1 --2- 10.20.193.40:0/3616068750 >> v2:10.20.193.120:6800/397309233 conn(0x7fe9340741d0 0x7fe934094680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- 10.20.193.40:0/3194999094 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3194159bc0 msgr2=0x7f3194162ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 --2- 10.20.193.40:0/3194999094 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3194159bc0 0x7f3194162ee0 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=1781886140882890318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3194160a60 tx=0x7f317c01c490 comp rx=0 tx=0).stop 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe960ff9640 1 -- 10.20.193.40:0/3616068750 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fe954010040 con 0x7fe96413d250 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe960ff9640 10 client.4635.objecter ms_dispatch2 0x7fe964000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe960ff9640 3 client.4635.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe960ff9640 3 client.4635.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe960ff9640 20 client.4635.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- 10.20.193.40:0/3194999094 shutdown_connections 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe960ff9640 1 -- 10.20.193.40:0/3616068750 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fe954097ad0 con 0x7fe96413d250 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 --2- 10.20.193.40:0/3194999094 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3194159bc0 0x7f3194162ee0 unknown :-1 s=CLOSED pgs=106 gs=3 cs=0 l=1 c_cookie=1781886140882890318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 --2- 10.20.193.40:0/3194999094 >> v2:10.20.193.40:3300/0 conn(0x7f31941597f0 0x7f3194058c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- 10.20.193.40:0/3194999094 >> 10.20.193.40:0/3194999094 conn(0x7f31940b8600 msgr2=0x7f31940b8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- 10.20.193.40:0/3194999094 shutdown_connections 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe963fff640 1 --2- 10.20.193.40:0/3616068750 >> v2:10.20.193.120:6800/397309233 conn(0x7fe9340741d0 0x7fe934094680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.308 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- 10.20.193.40:0/3194999094 wait complete. 2026-02-24T17:25:12.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe963fff640 1 --2- 10.20.193.40:0/3616068750 >> v2:10.20.193.120:6800/397309233 conn(0x7fe9340741d0 0x7fe934094680 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe95001c910 tx=0x7fe9500047b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7fe960ff9640 10 client.4635.objecter ms_handle_connect 0x7fe9340741d0 2026-02-24T17:25:12.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 librados: starting msgr at 2026-02-24T17:25:12.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 librados: starting objecter 2026-02-24T17:25:12.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 Processor -- start 2026-02-24T17:25:12.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- start start 2026-02-24T17:25:12.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 librados: setting wanted keys 2026-02-24T17:25:12.309 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 librados: calling monclient init 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f31941597f0 0x7f31941758a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3194159bc0 0x7f3194177280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3194163420 0x7f3194174a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f31940592c0 con 0x7f3194159bc0 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3194059140 con 0x7f3194163420 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f319911e640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f31940562b0 con 0x7f31941597f0 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f3192575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3194159bc0 0x7f3194177280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f3192575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3194159bc0 0x7f3194177280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60256/0 (socket says 10.20.193.40:60256) 2026-02-24T17:25:12.310 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f3192575640 1 -- 10.20.193.40:0/1599927067 learned_addr learned my addr 10.20.193.40:0/1599927067 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f3192d76640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f31941597f0 0x7f31941758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.299+0000 7f3193577640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3194163420 0x7f3194174a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192d76640 1 -- 10.20.193.40:0/1599927067 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3194163420 msgr2=0x7f3194174a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192d76640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3194163420 0x7f3194174a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192d76640 1 -- 10.20.193.40:0/1599927067 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3194159bc0 msgr2=0x7f3194177280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192d76640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3194159bc0 0x7f3194177280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192d76640 1 -- 10.20.193.40:0/1599927067 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3194175f00 con 0x7f31941597f0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192575640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3194159bc0 0x7f3194177280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192d76640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f31941597f0 0x7f31941758a0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f318800b520 tx=0x7f318800b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 10 client.?.objecter ms_handle_connect 0x7f31941597f0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 1 -- 10.20.193.40:0/1599927067 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31880044a0 con 0x7f31941597f0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 1 -- 10.20.193.40:0/1599927067 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3188015070 con 0x7f31941597f0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 1 -- 10.20.193.40:0/1599927067 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3188002900 con 0x7f31941597f0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f319911e640 1 -- 10.20.193.40:0/1599927067 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941761e0 con 0x7f31941597f0 2026-02-24T17:25:12.311 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f319911e640 10 client.4625.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f319911e640 1 -- 10.20.193.40:0/1599927067 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941767a0 con 0x7f31941597f0 2026-02-24T17:25:12.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f319911e640 1 librados: init done 2026-02-24T17:25:12.312 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31717fa640 1 -- 10.20.193.40:0/1599927067 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150005130 con 0x7f31941597f0 2026-02-24T17:25:12.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 1 -- 10.20.193.40:0/1599927067 <== mon.2 v2:10.20.193.109:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f318801a460 con 0x7f31941597f0 2026-02-24T17:25:12.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 1 --2- 10.20.193.40:0/1599927067 >> v2:10.20.193.120:6800/397309233 conn(0x7f3160074250 0x7f3160094700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 1 -- 10.20.193.40:0/1599927067 <== mon.2 v2:10.20.193.109:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f318800d040 con 0x7f31941597f0 2026-02-24T17:25:12.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 10 client.4625.objecter ms_dispatch2 0x7f3194000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 3 client.4625.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.313 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 3 client.4625.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 20 client.4625.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192575640 1 --2- 10.20.193.40:0/1599927067 >> v2:10.20.193.120:6800/397309233 conn(0x7f3160074250 0x7f3160094700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f3192575640 1 --2- 10.20.193.40:0/1599927067 >> v2:10.20.193.120:6800/397309233 conn(0x7f3160074250 0x7f3160094700 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f317c0095c0 tx=0x7f317c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.314 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.303+0000 7f31737fe640 10 client.4625.objecter ms_handle_connect 0x7f3160074250 2026-02-24T17:25:12.315 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.307+0000 7f31737fe640 1 -- 10.20.193.40:0/1599927067 <== mon.2 v2:10.20.193.109:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f3188060180 con 0x7f31941597f0 2026-02-24T17:25:12.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.4 2026-02-24T17:25:12.321 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.323 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.311+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1e1c0b3890 con 0x7f1e1c1618a0 2026-02-24T17:25:12.323 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e02ffd640 1 -- 10.20.193.40:0/1699335273 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e0c0f9fc0 con 0x7f1e1c1618a0 2026-02-24T17:25:12.324 INFO:teuthology.orchestra.run.trial040.stdout:90194313222 2026-02-24T17:25:12.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f2edc005420 con 0x7f2f1016ada0 2026-02-24T17:25:12.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2ef6ffd640 1 -- 10.20.193.40:0/2530855689 <== mon.1 v2:10.20.193.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f2f0c0a7e90 con 0x7f2f1016ada0 2026-02-24T17:25:12.324 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 10 librados: watch_flush enter 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 10 librados: watch_flush exit 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 20 client.4587.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 10 client.4587.objecter successfully canceled tick 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 >> v2:10.20.193.120:6800/397309233 conn(0x7f1dec074100 msgr2=0x7f1dec0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 --2- 10.20.193.40:0/1699335273 >> v2:10.20.193.120:6800/397309233 conn(0x7f1dec074100 0x7f1dec0945b0 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e1c168b70 tx=0x7f1e100037b0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 msgr2=0x7f1e1c120e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c120e10 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e0c002410 tx=0x7f1e0c01ada0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 10 librados: watch_flush enter 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 10 librados: watch_flush exit 2026-02-24T17:25:12.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 20 client.4543.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 10 client.4543.objecter successfully canceled tick 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 shutdown_connections 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 --2- 10.20.193.40:0/1699335273 >> v2:10.20.193.120:6800/397309233 conn(0x7f1dec074100 0x7f1dec0945b0 unknown :-1 s=CLOSED pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1e1c16ba90 0x7f1e1c121640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1e1c161c70 0x7f1e1c166dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 --2- 10.20.193.40:0/1699335273 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1e1c1618a0 0x7f1e1c120e10 unknown :-1 s=CLOSED pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 >> v2:10.20.193.120:6800/397309233 conn(0x7f2ee0074100 msgr2=0x7f2ee00945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 --2- 10.20.193.40:0/2530855689 >> v2:10.20.193.120:6800/397309233 conn(0x7f2ee0074100 0x7f2ee00945b0 secure :-1 s=READY pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f00007b60 tx=0x7f2f00007af0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 >> 10.20.193.40:0/1699335273 conn(0x7f1e1c0b8fd0 msgr2=0x7f1e1c0b93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1016ada0 msgr2=0x7f2f1017b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1016ada0 0x7f2f1017b030 secure :-1 s=READY pgs=88 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f0c01b520 tx=0x7f2f0c01a690 comp rx=0 tx=0).stop 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 shutdown_connections 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 -- 10.20.193.40:0/1699335273 wait complete. 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 shutdown_connections 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 --2- 10.20.193.40:0/2530855689 >> v2:10.20.193.120:6800/397309233 conn(0x7f2ee0074100 0x7f2ee00945b0 unknown :-1 s=CLOSED pgs=100 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2f1016ada0 0x7f2f1017b030 unknown :-1 s=CLOSED pgs=88 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2f1005d570 0x7f2f1017aaf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 --2- 10.20.193.40:0/2530855689 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2f1005d1a0 0x7f2f10169500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 >> 10.20.193.40:0/2530855689 conn(0x7f2f100bd200 msgr2=0x7f2f1015aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f1e24325640 1 librados: shutdown 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 shutdown_connections 2026-02-24T17:25:12.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 -- 10.20.193.40:0/2530855689 wait complete. 2026-02-24T17:25:12.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.315+0000 7f2f18395640 1 librados: shutdown 2026-02-24T17:25:12.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.323+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb7781572f0 con 0x7fb778159f70 2026-02-24T17:25:12.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.323+0000 7fb753fff640 1 -- 10.20.193.40:0/3972747916 <== mon.2 v2:10.20.193.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb76c0662b0 con 0x7fb778159f70 2026-02-24T17:25:12.333 INFO:teuthology.orchestra.run.trial040.stdout:90194313221 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.323+0000 7fb77e162640 10 librados: watch_flush enter 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.323+0000 7fb77e162640 10 librados: watch_flush exit 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.323+0000 7fb77e162640 20 client.4568.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.323+0000 7fb77e162640 10 client.4568.objecter successfully canceled tick 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 >> v2:10.20.193.120:6800/397309233 conn(0x7fb748074180 msgr2=0x7fb748094630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 --2- 10.20.193.40:0/3972747916 >> v2:10.20.193.120:6800/397309233 conn(0x7fb748074180 0x7fb748094630 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7640037b0 tx=0x7fb7640037e0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb778159f70 msgr2=0x7fb778162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 --2- 10.20.193.40:0/3972747916 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb778159f70 0x7fb778162b20 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb76c00da70 tx=0x7fb76c00df30 comp rx=0 tx=0).stop 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 shutdown_connections 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 --2- 10.20.193.40:0/3972747916 >> v2:10.20.193.120:6800/397309233 conn(0x7fb748074180 0x7fb748094630 unknown :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 --2- 10.20.193.40:0/3972747916 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb778159f70 0x7fb778162b20 unknown :-1 s=CLOSED pgs=99 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 --2- 10.20.193.40:0/3972747916 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb7780b5110 0x7fb7781614e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 --2- 10.20.193.40:0/3972747916 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb778057eb0 0x7fb7781797f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 >> 10.20.193.40:0/3972747916 conn(0x7fb7780b9d40 msgr2=0x7fb778054260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 shutdown_connections 2026-02-24T17:25:12.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f41440606a0 con 0x7f41440b55c0 2026-02-24T17:25:12.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 -- 10.20.193.40:0/3972747916 wait complete. 2026-02-24T17:25:12.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7fb77e162640 1 librados: shutdown 2026-02-24T17:25:12.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f411ffff640 1 -- 10.20.193.40:0/2274332075 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f41340161b0 con 0x7f41440b55c0 2026-02-24T17:25:12.336 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 10 librados: watch_flush enter 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 10 librados: watch_flush exit 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 20 client.4599.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 10 client.4599.objecter successfully canceled tick 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 >> v2:10.20.193.120:6800/397309233 conn(0x7f4114074100 msgr2=0x7f41140945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 --2- 10.20.193.40:0/2274332075 >> v2:10.20.193.120:6800/397309233 conn(0x7f4114074100 0x7f41140945b0 secure :-1 s=READY pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4130004970 tx=0x7f4130003620 comp rx=0 tx=0).stop 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41440b55c0 msgr2=0x7f4144135160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 --2- 10.20.193.40:0/2274332075 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41440b55c0 0x7f4144135160 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4134003010 tx=0x7f4128005900 comp rx=0 tx=0).stop 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 shutdown_connections 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 --2- 10.20.193.40:0/2274332075 >> v2:10.20.193.120:6800/397309233 conn(0x7f4114074100 0x7f41140945b0 unknown :-1 s=CLOSED pgs=102 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 --2- 10.20.193.40:0/2274332075 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f41440b6dc0 0x7f4144139100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 --2- 10.20.193.40:0/2274332075 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f41440b55c0 0x7f4144135160 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 --2- 10.20.193.40:0/2274332075 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f41280048d0 0x7f41440562b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 >> 10.20.193.40:0/2274332075 conn(0x7f41440bb5e0 msgr2=0x7f4144139a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 shutdown_connections 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 -- 10.20.193.40:0/2274332075 wait complete. 2026-02-24T17:25:12.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.327+0000 7f4149fdb640 1 librados: shutdown 2026-02-24T17:25:12.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.12 2026-02-24T17:25:12.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313222 for osd.0 2026-02-24T17:25:12.339 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.340 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f54fc0599e0 con 0x7f54fc0b38f0 2026-02-24T17:25:12.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f54e2ffd640 1 -- 10.20.193.40:0/3289748108 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54ec016210 con 0x7f54fc0b38f0 2026-02-24T17:25:12.340 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 10 librados: watch_flush enter 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 10 librados: watch_flush exit 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 20 client.4596.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 10 client.4596.objecter successfully canceled tick 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 >> v2:10.20.193.120:6800/397309233 conn(0x7f54cc074070 msgr2=0x7f54cc094520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 --2- 10.20.193.40:0/3289748108 >> v2:10.20.193.120:6800/397309233 conn(0x7f54cc074070 0x7f54cc094520 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54f0002810 tx=0x7f54f0009040 comp rx=0 tx=0).stop 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54fc0b38f0 msgr2=0x7f54fc154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54fc0b38f0 0x7f54fc154b40 secure :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54ec01cb60 tx=0x7f54ec01ae30 comp rx=0 tx=0).stop 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 shutdown_connections 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 --2- 10.20.193.40:0/3289748108 >> v2:10.20.193.120:6800/397309233 conn(0x7f54cc074070 0x7f54cc094520 unknown :-1 s=CLOSED pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f54fc15ac20 0x7f54fc058820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f54fc0b95b0 0x7f54fc17e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 --2- 10.20.193.40:0/3289748108 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f54fc0b38f0 0x7f54fc154b40 unknown :-1 s=CLOSED pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 >> 10.20.193.40:0/3289748108 conn(0x7f54fc0b9b50 msgr2=0x7f54fc1588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 shutdown_connections 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 -- 10.20.193.40:0/3289748108 wait complete. 2026-02-24T17:25:12.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.331+0000 7f550439d640 1 librados: shutdown 2026-02-24T17:25:12.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.9 2026-02-24T17:25:12.348 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.14 2026-02-24T17:25:12.349 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 -- 10.20.193.40:0/2995899048 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7fcc18005420 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc49ffb640 1 -- 10.20.193.40:0/2995899048 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fcc4c0ad020 con 0x7fcc5c05d1a0 2026-02-24T17:25:12.351 INFO:teuthology.orchestra.run.trial040.stdout:90194313221 2026-02-24T17:25:12.352 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f628845d640 1 Processor -- start 2026-02-24T17:25:12.352 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f628845d640 1 -- start start 2026-02-24T17:25:12.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.6 2026-02-24T17:25:12.353 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f628845d640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f62800b2500 0x7f62800b28d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.353 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f628845d640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628016aed0 con 0x7f62801607f0 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f628845d640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6280166de0 con 0x7f62800b3560 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f628845d640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6280166bb0 con 0x7f62800b2500 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62859d1640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7f62800b3560 0x7f62800b3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.40:48110/0 (socket says 10.20.193.40:48110) 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62859d1640 1 -- 10.20.193.40:0/1021872403 learned_addr learned my addr 10.20.193.40:0/1021872403 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62861d2640 1 --2- 10.20.193.40:0/1021872403 >> v2:10.20.193.94:3300/0 conn(0x7f62800b2500 0x7f62800b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 10 librados: watch_flush enter 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 10 librados: watch_flush exit 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 20 client.4617.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 10 client.4617.objecter successfully canceled tick 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 -- 10.20.193.40:0/2995899048 >> v2:10.20.193.120:6800/397309233 conn(0x7fcc2c074100 msgr2=0x7fcc2c0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 --2- 10.20.193.40:0/2995899048 >> v2:10.20.193.120:6800/397309233 conn(0x7fcc2c074100 0x7fcc2c0945b0 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc5c164570 tx=0x7fcc50009290 comp rx=0 tx=0).stop 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 -- 10.20.193.40:0/2995899048 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 msgr2=0x7fcc5c1698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.354 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c1698d0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc4c004780 tx=0x7fcc4c019370 comp rx=0 tx=0).stop 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 <== mon.2 v1:10.20.193.109:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903134636 0 0) 0x7f6280166de0 con 0x7f62800b3560 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 --> v1:10.20.193.109:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6268003620 con 0x7f62800b3560 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 -- 10.20.193.40:0/2995899048 shutdown_connections 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 --2- 10.20.193.40:0/2995899048 >> v2:10.20.193.120:6800/397309233 conn(0x7fcc2c074100 0x7fcc2c0945b0 unknown :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fcc5c16ada0 0x7fcc5c124330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fcc5c0bc470 0x7fcc5c123df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 --2- 10.20.193.40:0/2995899048 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fcc5c05d1a0 0x7fcc5c1698d0 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 -- 10.20.193.40:0/2995899048 >> 10.20.193.40:0/2995899048 conn(0x7fcc5c0bd200 msgr2=0x7fcc5c0bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686540047 0 0) 0x7f628016aed0 con 0x7f62801607f0 2026-02-24T17:25:12.355 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6280166de0 con 0x7f62801607f0 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 -- 10.20.193.40:0/2995899048 shutdown_connections 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 <== mon.2 v1:10.20.193.109:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 540823392 0 0) 0x7f6268003620 con 0x7f62800b3560 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 >> v2:10.20.193.94:3300/0 conn(0x7f62800b2500 msgr2=0x7f62800b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 -- 10.20.193.40:0/2995899048 wait complete. 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 --2- 10.20.193.40:0/1021872403 >> v2:10.20.193.94:3300/0 conn(0x7f62800b2500 0x7f62800b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 >> v1:10.20.193.94:6789/0 conn(0x7f62801607f0 legacy=0x7f6280160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 --> v1:10.20.193.109:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62801670c0 con 0x7f62800b3560 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 <== mon.2 v1:10.20.193.109:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f6274002e80 con 0x7f62800b3560 2026-02-24T17:25:12.356 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7fcc2b7fe640 1 librados: shutdown 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 >> v1:10.20.193.109:6789/0 conn(0x7f62800b3560 legacy=0x7f62800b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6268003dd0 0x7f62680041c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6268004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6268005450 0x7f6268065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f62680662f0 con 0x7f62680048d0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f62680664a0 con 0x7f6268005450 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f62680666a0 con 0x7f6268003dd0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62859d1640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6268004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62861d2640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6268003dd0 0x7f62680041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62859d1640 1 -- 10.20.193.40:0/1021872403 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6268003dd0 msgr2=0x7f62680041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62859d1640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6268003dd0 0x7f62680041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62859d1640 1 -- 10.20.193.40:0/1021872403 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6268005450 msgr2=0x7f6268065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62869d3640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6268005450 0x7f6268065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62859d1640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6268005450 0x7f6268065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62859d1640 1 -- 10.20.193.40:0/1021872403 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6268003620 con 0x7f62680048d0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62869d3640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6268005450 0x7f6268065a90 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.343+0000 7f62869d3640 1 -- 10.20.193.40:0/1021872403 reap_dead start 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62859d1640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6268004d40 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=12064850479281191408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62740036c0 tx=0x7f627401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76ef596adc1b9f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6274007d40 con 0x7f62680048d0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62740a9020 con 0x7f62680048d0 2026-02-24T17:25:12.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62851d0640 1 -- 10.20.193.40:0/1021872403 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62740a5750 con 0x7f62680048d0 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- 10.20.193.40:0/1021872403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 msgr2=0x7f6268004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6268004d40 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=12064850479281191408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62740036c0 tx=0x7f627401cc00 comp rx=0 tx=0).stop 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- 10.20.193.40:0/1021872403 shutdown_connections 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 --2- 10.20.193.40:0/1021872403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6268004d40 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=12064850479281191408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- 10.20.193.40:0/1021872403 >> 10.20.193.40:0/1021872403 conn(0x7f62800b8fd0 msgr2=0x7f62800b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- 10.20.193.40:0/1021872403 shutdown_connections 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- 10.20.193.40:0/1021872403 wait complete. 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 librados: starting msgr at 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 librados: starting objecter 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 Processor -- start 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- start start 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 librados: setting wanted keys 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 librados: calling monclient init 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6280142c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6280141460 0x7f6280162650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6280205fb0 0x7f62800b6f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f62800b4040 con 0x7f62680048d0 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f62800b3ec0 con 0x7f6280205fb0 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f62800b41c0 con 0x7f6280141460 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6280142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6280142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60280/0 (socket says 10.20.193.40:60280) 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 -- 10.20.193.40:0/2294608588 learned_addr learned my addr 10.20.193.40:0/2294608588 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62869d3640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6280205fb0 0x7f62800b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 -- 10.20.193.40:0/2294608588 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6280141460 msgr2=0x7f6280162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62859d1640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6280141460 0x7f6280162650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6280141460 0x7f6280162650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 -- 10.20.193.40:0/2294608588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6280205fb0 msgr2=0x7f62800b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6280205fb0 0x7f62800b6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 -- 10.20.193.40:0/2294608588 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62801418e0 con 0x7f62680048d0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62869d3640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6280205fb0 0x7f62800b6f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62859d1640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6280141460 0x7f6280162650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f6266ffd640 10 client.?.objecter ms_handle_connect 0x7f62680048d0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f6266ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f62861d2640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6280142c60 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62700118d0 tx=0x7f6270011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f6266ffd640 1 -- 10.20.193.40:0/2294608588 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f627000fbf0 con 0x7f62680048d0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f6266ffd640 1 -- 10.20.193.40:0/2294608588 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627000fd90 con 0x7f62680048d0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6280141bc0 con 0x7f62680048d0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f6266ffd640 1 -- 10.20.193.40:0/2294608588 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62700156a0 con 0x7f62680048d0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 10 client.4641.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6280142180 con 0x7f62680048d0 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 librados: init done 2026-02-24T17:25:12.361 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.347+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628016a130 con 0x7f62680048d0 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 1 -- 10.20.193.40:0/2294608588 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f6270025030 con 0x7f62680048d0 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 1 --2- 10.20.193.40:0/2294608588 >> v2:10.20.193.120:6800/397309233 conn(0x7f62500740a0 0x7f6250094550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 1 -- 10.20.193.40:0/2294608588 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f6270096650 con 0x7f62680048d0 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 10 client.4641.objecter ms_dispatch2 0x7f6280000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 3 client.4641.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 3 client.4641.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 20 client.4641.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f62859d1640 1 --2- 10.20.193.40:0/2294608588 >> v2:10.20.193.120:6800/397309233 conn(0x7f62500740a0 0x7f6250094550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 10 client.4641.objecter ms_handle_connect 0x7f62500740a0 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f62859d1640 1 --2- 10.20.193.40:0/2294608588 >> v2:10.20.193.120:6800/397309233 conn(0x7f62500740a0 0x7f6250094550 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6274007c10 tx=0x7f628016b0a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.362 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.351+0000 7f6266ffd640 1 -- 10.20.193.40:0/2294608588 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f6270019030 con 0x7f62680048d0 2026-02-24T17:25:12.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.13 2026-02-24T17:25:12.366 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.375 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.363+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7efddc05d570 con 0x7efdc00048d0 2026-02-24T17:25:12.375 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efdd8ff9640 1 -- 10.20.193.40:0/2548016837 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7efdc8062080 con 0x7efdc00048d0 2026-02-24T17:25:12.375 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 10 librados: watch_flush enter 2026-02-24T17:25:12.377 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 10 librados: watch_flush exit 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 20 client.4614.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 10 client.4614.objecter successfully canceled tick 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 >> v2:10.20.193.120:6800/397309233 conn(0x7efdac0740f0 msgr2=0x7efdac0945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 --2- 10.20.193.40:0/2548016837 >> v2:10.20.193.120:6800/397309233 conn(0x7efdac0740f0 0x7efdac0945a0 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdcc01c980 tx=0x7efdcc0047b0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 msgr2=0x7efddc168770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efddc168770 secure :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdc80034d0 tx=0x7efdc80105b0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 shutdown_connections 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 --2- 10.20.193.40:0/2548016837 >> v2:10.20.193.120:6800/397309233 conn(0x7efdac0740f0 0x7efdac0945a0 unknown :-1 s=CLOSED pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7efddc165d20 0x7efddc1f9090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7efddc168cb0 0x7efddc1f8b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 --2- 10.20.193.40:0/2548016837 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7efdc00048d0 0x7efddc168770 unknown :-1 s=CLOSED pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 >> 10.20.193.40:0/2548016837 conn(0x7efddc0bd200 msgr2=0x7efddc0b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 shutdown_connections 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 -- 10.20.193.40:0/2548016837 wait complete. 2026-02-24T17:25:12.378 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.367+0000 7efde24f0640 1 librados: shutdown 2026-02-24T17:25:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.371+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f55b80b7dc0 con 0x7f55b80bc470 2026-02-24T17:25:12.383 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55ad7fa640 1 -- 10.20.193.40:0/4122025267 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f55a0065470 con 0x7f55b80bc470 2026-02-24T17:25:12.383 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f90280b7f30 con 0x7f9028147a60 2026-02-24T17:25:12.385 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f90077fe640 1 -- 10.20.193.40:0/2967685557 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f9010066580 con 0x7f9028147a60 2026-02-24T17:25:12.385 INFO:teuthology.orchestra.run.trial040.stdout:90194313221 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 10 librados: watch_flush enter 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 10 librados: watch_flush exit 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 20 client.4620.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 10 client.4620.objecter successfully canceled tick 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 >> v2:10.20.193.120:6800/397309233 conn(0x7f5588074250 msgr2=0x7f5588094700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 --2- 10.20.193.40:0/4122025267 >> v2:10.20.193.120:6800/397309233 conn(0x7f5588074250 0x7f5588094700 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55a801c570 tx=0x7f55a80b3040 comp rx=0 tx=0).stop 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f55b80bc470 msgr2=0x7f55b8162840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f55b80bc470 0x7f55b8162840 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55a000c550 tx=0x7f55a000ca10 comp rx=0 tx=0).stop 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 shutdown_connections 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 --2- 10.20.193.40:0/4122025267 >> v2:10.20.193.120:6800/397309233 conn(0x7f5588074250 0x7f5588094700 unknown :-1 s=CLOSED pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f55b816ada0 0x7f55b8161470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f55b80bc470 0x7f55b8162840 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 --2- 10.20.193.40:0/4122025267 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f55b805d1a0 0x7f55b8158650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 >> 10.20.193.40:0/4122025267 conn(0x7f55b80bd200 msgr2=0x7f55b80b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.386 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 shutdown_connections 2026-02-24T17:25:12.387 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 -- 10.20.193.40:0/4122025267 wait complete. 2026-02-24T17:25:12.387 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.375+0000 7f55bf010640 1 librados: shutdown 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 10 librados: watch_flush enter 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 10 librados: watch_flush exit 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 20 client.4605.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 10 client.4605.objecter successfully canceled tick 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 >> v2:10.20.193.120:6800/397309233 conn(0x7f8ff4074100 msgr2=0x7f8ff40945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 --2- 10.20.193.40:0/2967685557 >> v2:10.20.193.120:6800/397309233 conn(0x7f8ff4074100 0x7f8ff40945b0 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901c002b70 tx=0x7f901c002fa0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9028147a60 msgr2=0x7f9028147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9028147a60 0x7f9028147ed0 secure :-1 s=READY pgs=168 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f901000ea50 tx=0x7f901000ef10 comp rx=0 tx=0).stop 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 shutdown_connections 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 --2- 10.20.193.40:0/2967685557 >> v2:10.20.193.120:6800/397309233 conn(0x7f8ff4074100 0x7f8ff40945b0 unknown :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9028149220 0x7f9028149650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9028147a60 0x7f9028147ed0 unknown :-1 s=CLOSED pgs=168 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 --2- 10.20.193.40:0/2967685557 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9014005340 0x7f9028140860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 >> 10.20.193.40:0/2967685557 conn(0x7f90280bd200 msgr2=0x7f902815aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 shutdown_connections 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 -- 10.20.193.40:0/2967685557 wait complete. 2026-02-24T17:25:12.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f902d405640 1 librados: shutdown 2026-02-24T17:25:12.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.10 2026-02-24T17:25:12.389 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f32e8169460 con 0x7f32e80bc470 2026-02-24T17:25:12.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.379+0000 7f32c77fe640 1 -- 10.20.193.40:0/303398851 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32d0016110 con 0x7f32e80bc470 2026-02-24T17:25:12.391 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 10 librados: watch_flush enter 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 10 librados: watch_flush exit 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 20 client.4611.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 10 client.4611.objecter successfully canceled tick 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 >> v2:10.20.193.120:6800/397309233 conn(0x7f32b40741d0 msgr2=0x7f32b4094680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/303398851 >> v2:10.20.193.120:6800/397309233 conn(0x7f32b40741d0 0x7f32b4094680 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32dc004780 tx=0x7f32dc008040 comp rx=0 tx=0).stop 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32e80bc470 msgr2=0x7f32e8131d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32e80bc470 0x7f32e8131d80 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d001ca60 tx=0x7f32d0019290 comp rx=0 tx=0).stop 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 shutdown_connections 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/303398851 >> v2:10.20.193.120:6800/397309233 conn(0x7f32b40741d0 0x7f32b4094680 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f32e816ada0 0x7f32e8126660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f32e80bc470 0x7f32e8131d80 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 --2- 10.20.193.40:0/303398851 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f32e805d1a0 0x7f32e81689b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 >> 10.20.193.40:0/303398851 conn(0x7f32e80bd200 msgr2=0x7f32e815b280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 shutdown_connections 2026-02-24T17:25:12.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 -- 10.20.193.40:0/303398851 wait complete. 2026-02-24T17:25:12.394 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.383+0000 7f32ed4d0640 1 librados: shutdown 2026-02-24T17:25:12.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fa1a80b82f0 con 0x7fa1a816ada0 2026-02-24T17:25:12.396 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa183fff640 1 -- 10.20.193.40:0/361062604 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fa19c060f90 con 0x7fa1a816ada0 2026-02-24T17:25:12.396 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 10 librados: watch_flush enter 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 10 librados: watch_flush exit 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 20 client.4602.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 10 client.4602.objecter successfully canceled tick 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 >> v2:10.20.193.120:6800/397309233 conn(0x7fa1780741c0 msgr2=0x7fa178094670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 --2- 10.20.193.40:0/361062604 >> v2:10.20.193.120:6800/397309233 conn(0x7fa1780741c0 0x7fa178094670 secure :-1 s=READY pgs=103 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa194002410 tx=0x7fa1940a7000 comp rx=0 tx=0).stop 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a816ada0 msgr2=0x7fa1a8129b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 --2- 10.20.193.40:0/361062604 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a816ada0 0x7fa1a8129b20 secure :-1 s=READY pgs=167 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa19c00da70 tx=0x7fa19c00de70 comp rx=0 tx=0).stop 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 shutdown_connections 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 --2- 10.20.193.40:0/361062604 >> v2:10.20.193.120:6800/397309233 conn(0x7fa1780741c0 0x7fa178094670 unknown :-1 s=CLOSED pgs=103 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 --2- 10.20.193.40:0/361062604 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa1a816ada0 0x7fa1a8129b20 unknown :-1 s=CLOSED pgs=167 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 --2- 10.20.193.40:0/361062604 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa1a80bc470 0x7fa1a81295e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 --2- 10.20.193.40:0/361062604 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa1a805d1a0 0x7fa1a8169500 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.387+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 >> 10.20.193.40:0/361062604 conn(0x7fa1a80bd200 msgr2=0x7fa1a80bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.391+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 shutdown_connections 2026-02-24T17:25:12.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.391+0000 7fa1adb19640 1 -- 10.20.193.40:0/361062604 wait complete. 2026-02-24T17:25:12.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.391+0000 7fa1adb19640 1 librados: shutdown 2026-02-24T17:25:12.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.15 2026-02-24T17:25:12.400 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.1 2026-02-24T17:25:12.401 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.8 2026-02-24T17:25:12.404 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.11 2026-02-24T17:25:12.412 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f916c0b8680 con 0x7f916c0bc470 2026-02-24T17:25:12.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9147fff640 1 -- 10.20.193.40:0/2369481106 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f915c016210 con 0x7f916c0bc470 2026-02-24T17:25:12.432 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 10 librados: watch_flush enter 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 10 librados: watch_flush exit 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 20 client.4629.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 10 client.4629.objecter successfully canceled tick 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 >> v2:10.20.193.120:6800/397309233 conn(0x7f913c0740f0 msgr2=0x7f913c0945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 --2- 10.20.193.40:0/2369481106 >> v2:10.20.193.120:6800/397309233 conn(0x7f913c0740f0 0x7f913c0945a0 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9158002770 tx=0x7f9158007f30 comp rx=0 tx=0).stop 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c0bc470 msgr2=0x7f916c120f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c0bc470 0x7f916c120f50 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915c01cb60 tx=0x7f915c01ae30 comp rx=0 tx=0).stop 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 shutdown_connections 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 --2- 10.20.193.40:0/2369481106 >> v2:10.20.193.120:6800/397309233 conn(0x7f913c0740f0 0x7f913c0945a0 unknown :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f916c16ada0 0x7f916c11e6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f916c0bc470 0x7f916c120f50 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 --2- 10.20.193.40:0/2369481106 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f916c05d1a0 0x7f916c13ecc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 >> 10.20.193.40:0/2369481106 conn(0x7f916c0bd200 msgr2=0x7f916c0bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 shutdown_connections 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 -- 10.20.193.40:0/2369481106 wait complete. 2026-02-24T17:25:12.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.423+0000 7f9171cb9640 1 librados: shutdown 2026-02-24T17:25:12.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 -- 10.20.193.40:0/1599927067 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f31500056f0 con 0x7f31941597f0 2026-02-24T17:25:12.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31737fe640 1 -- 10.20.193.40:0/1599927067 <== mon.2 v2:10.20.193.109:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3188065a00 con 0x7f31941597f0 2026-02-24T17:25:12.436 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 10 librados: watch_flush enter 2026-02-24T17:25:12.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 10 librados: watch_flush exit 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 20 client.4625.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 10 client.4625.objecter successfully canceled tick 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 -- 10.20.193.40:0/1599927067 >> v2:10.20.193.120:6800/397309233 conn(0x7f3160074250 msgr2=0x7f3160094700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 --2- 10.20.193.40:0/1599927067 >> v2:10.20.193.120:6800/397309233 conn(0x7f3160074250 0x7f3160094700 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f317c0095c0 tx=0x7f317c008040 comp rx=0 tx=0).stop 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 -- 10.20.193.40:0/1599927067 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f31941597f0 msgr2=0x7f31941758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f31941597f0 0x7f31941758a0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f318800b520 tx=0x7f318800b9e0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 -- 10.20.193.40:0/1599927067 shutdown_connections 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 --2- 10.20.193.40:0/1599927067 >> v2:10.20.193.120:6800/397309233 conn(0x7f3160074250 0x7f3160094700 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3194163420 0x7f3194174a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3194159bc0 0x7f3194177280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 --2- 10.20.193.40:0/1599927067 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f31941597f0 0x7f31941758a0 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 -- 10.20.193.40:0/1599927067 >> 10.20.193.40:0/1599927067 conn(0x7f31940b8600 msgr2=0x7f319405d030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 -- 10.20.193.40:0/1599927067 shutdown_connections 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 -- 10.20.193.40:0/1599927067 wait complete. 2026-02-24T17:25:12.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7f31717fa640 1 librados: shutdown 2026-02-24T17:25:12.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe9640b7680 con 0x7fe96413d250 2026-02-24T17:25:12.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.427+0000 7fe960ff9640 1 -- 10.20.193.40:0/3616068750 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe95405f590 con 0x7fe96413d250 2026-02-24T17:25:12.440 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 10 librados: watch_flush enter 2026-02-24T17:25:12.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 10 librados: watch_flush exit 2026-02-24T17:25:12.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 20 client.4635.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 10 client.4635.objecter successfully canceled tick 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 >> v2:10.20.193.120:6800/397309233 conn(0x7fe9340741d0 msgr2=0x7fe934094680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 --2- 10.20.193.40:0/3616068750 >> v2:10.20.193.120:6800/397309233 conn(0x7fe9340741d0 0x7fe934094680 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe95001c910 tx=0x7fe9500047b0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe96413d250 msgr2=0x7fe964165f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe96413d250 0x7fe964165f80 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9540027c0 tx=0x7fe95400e840 comp rx=0 tx=0).stop 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 shutdown_connections 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 --2- 10.20.193.40:0/3616068750 >> v2:10.20.193.120:6800/397309233 conn(0x7fe9340741d0 0x7fe934094680 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fe9641664c0 0x7fe964122280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fe96413d250 0x7fe964165f80 unknown :-1 s=CLOSED pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 --2- 10.20.193.40:0/3616068750 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fe948003dd0 0x7fe96411e9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 >> 10.20.193.40:0/3616068750 conn(0x7fe9640bd200 msgr2=0x7fe96416a200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 shutdown_connections 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 -- 10.20.193.40:0/3616068750 wait complete. 2026-02-24T17:25:12.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.431+0000 7fe96a28c640 1 librados: shutdown 2026-02-24T17:25:12.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.3 2026-02-24T17:25:12.445 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.5 2026-02-24T17:25:12.449 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.2 2026-02-24T17:25:12.452 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6280136940 con 0x7f62680048d0 2026-02-24T17:25:12.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f6266ffd640 1 -- 10.20.193.40:0/2294608588 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6270060390 con 0x7f62680048d0 2026-02-24T17:25:12.457 INFO:teuthology.orchestra.run.trial040.stdout:90194313220 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 10 librados: watch_flush enter 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 10 librados: watch_flush exit 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 20 client.4641.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 10 client.4641.objecter successfully canceled tick 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 >> v2:10.20.193.120:6800/397309233 conn(0x7f62500740a0 msgr2=0x7f6250094550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 --2- 10.20.193.40:0/2294608588 >> v2:10.20.193.120:6800/397309233 conn(0x7f62500740a0 0x7f6250094550 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6274007c10 tx=0x7f628016b0a0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 msgr2=0x7f6280142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6280142c60 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62700118d0 tx=0x7f6270011d90 comp rx=0 tx=0).stop 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 shutdown_connections 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 --2- 10.20.193.40:0/2294608588 >> v2:10.20.193.120:6800/397309233 conn(0x7f62500740a0 0x7f6250094550 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.459 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6280205fb0 0x7f62800b6f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.460 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6280141460 0x7f6280162650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.460 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 --2- 10.20.193.40:0/2294608588 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f62680048d0 0x7f6280142c60 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.460 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 >> 10.20.193.40:0/2294608588 conn(0x7f62800b8fd0 msgr2=0x7f62800b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.460 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 shutdown_connections 2026-02-24T17:25:12.460 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 -- 10.20.193.40:0/2294608588 wait complete. 2026-02-24T17:25:12.460 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.447+0000 7f628845d640 1 librados: shutdown 2026-02-24T17:25:12.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313220 for osd.7 2026-02-24T17:25:12.471 DEBUG:teuthology.parallel:result is None 2026-02-24T17:25:12.471 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T17:25:12.471 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T17:25:12.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6480a12640 1 Processor -- start 2026-02-24T17:25:12.577 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6480a12640 1 -- start start 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6480a12640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f647c1618a0 0x7f647c0b3890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6480a12640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f647c161c70 0x7f647c16b380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6480a12640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c16e870 con 0x7f647c16b8c0 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6480a12640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f647c16e620 con 0x7f647c161c70 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6480a12640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f647c16eb50 con 0x7f647c1618a0 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6479d74640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f647c161c70 0x7f647c16b380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f647ad76640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f647c16b8c0 0x7f647c0b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49368/0 (socket says 10.20.193.40:49368) 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6479d74640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f647c161c70 0x7f647c16b380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60290/0 (socket says 10.20.193.40:60290) 2026-02-24T17:25:12.578 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f647ad76640 1 -- 10.20.193.40:0/1604344888 learned_addr learned my addr 10.20.193.40:0/1604344888 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f647a575640 1 --2- 10.20.193.40:0/1604344888 >> v2:10.20.193.109:3300/0 conn(0x7f647c1618a0 0x7f647c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6479d74640 1 -- 10.20.193.40:0/1604344888 >> v2:10.20.193.109:3300/0 conn(0x7f647c1618a0 msgr2=0x7f647c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6479d74640 1 --2- 10.20.193.40:0/1604344888 >> v2:10.20.193.109:3300/0 conn(0x7f647c1618a0 0x7f647c0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6479d74640 1 -- 10.20.193.40:0/1604344888 >> v1:10.20.193.40:6789/0 conn(0x7f647c16b8c0 legacy=0x7f647c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6479d74640 1 -- 10.20.193.40:0/1604344888 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c16ee30 con 0x7f647c161c70 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.567+0000 7f6479573640 1 -- 10.20.193.40:0/1604344888 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081507913 0 0) 0x7f647c16e870 con 0x7f647c16b8c0 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6479d74640 1 --2- 10.20.193.40:0/1604344888 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c161c70 0x7f647c16b380 secure :-1 s=READY pgs=186 gs=2 cs=0 l=1 c_cookie=7150825289523910730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c0b8a80 tx=0x7f646401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633cd5b6d0f3d84a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6479573640 1 -- 10.20.193.40:0/1604344888 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64640aa450 con 0x7f647c161c70 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6479573640 1 -- 10.20.193.40:0/1604344888 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64640af070 con 0x7f647c161c70 2026-02-24T17:25:12.579 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6479573640 1 -- 10.20.193.40:0/1604344888 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64640aa830 con 0x7f647c161c70 2026-02-24T17:25:12.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- 10.20.193.40:0/1604344888 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c161c70 msgr2=0x7f647c16b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 --2- 10.20.193.40:0/1604344888 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c161c70 0x7f647c16b380 secure :-1 s=READY pgs=186 gs=2 cs=0 l=1 c_cookie=7150825289523910730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c0b8a80 tx=0x7f646401c4f0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- 10.20.193.40:0/1604344888 shutdown_connections 2026-02-24T17:25:12.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 --2- 10.20.193.40:0/1604344888 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c161c70 0x7f647c16b380 unknown :-1 s=CLOSED pgs=186 gs=2 cs=0 l=1 c_cookie=7150825289523910730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 --2- 10.20.193.40:0/1604344888 >> v2:10.20.193.109:3300/0 conn(0x7f647c1618a0 0x7f647c0b3890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- 10.20.193.40:0/1604344888 >> 10.20.193.40:0/1604344888 conn(0x7f647c0b8fd0 msgr2=0x7f647c0b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- 10.20.193.40:0/1604344888 shutdown_connections 2026-02-24T17:25:12.580 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- 10.20.193.40:0/1604344888 wait complete. 2026-02-24T17:25:12.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 librados: starting msgr at 2026-02-24T17:25:12.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 librados: starting objecter 2026-02-24T17:25:12.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 Processor -- start 2026-02-24T17:25:12.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- start start 2026-02-24T17:25:12.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 librados: setting wanted keys 2026-02-24T17:25:12.581 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 librados: calling monclient init 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f647c1618a0 0x7f647c1420b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f647c161c70 0x7f647c1425f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c16b8c0 0x7f647c057690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b4880 con 0x7f647c16b8c0 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b4700 con 0x7f647c161c70 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b4a00 con 0x7f647c1618a0 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c16b8c0 0x7f647c057690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c16b8c0 0x7f647c057690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60306/0 (socket says 10.20.193.40:60306) 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 -- 10.20.193.40:0/1497947058 learned_addr learned my addr 10.20.193.40:0/1497947058 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647a575640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f647c1618a0 0x7f647c1420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.582 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6479d74640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f647c161c70 0x7f647c1425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 -- 10.20.193.40:0/1497947058 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f647c1618a0 msgr2=0x7f647c1420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f647c1618a0 0x7f647c1420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 -- 10.20.193.40:0/1497947058 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f647c161c70 msgr2=0x7f647c1425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f647c161c70 0x7f647c1425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 -- 10.20.193.40:0/1497947058 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c1cf780 con 0x7f647c16b8c0 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f647ad76640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c16b8c0 0x7f647c057690 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f646c00dac0 tx=0x7f646c00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6462ffd640 10 client.?.objecter ms_handle_connect 0x7f647c16b8c0 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6462ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.583 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6462ffd640 1 -- 10.20.193.40:0/1497947058 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f646c019070 con 0x7f647c16b8c0 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6462ffd640 1 -- 10.20.193.40:0/1497947058 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c00ba40 con 0x7f647c16b8c0 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6462ffd640 1 -- 10.20.193.40:0/1497947058 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f646c00be50 con 0x7f647c16b8c0 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c169fb0 con 0x7f647c16b8c0 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 10 client.4650.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1412f0 con 0x7f647c16b8c0 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 librados: init done 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.571+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c16e870 con 0x7f647c16b8c0 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 1 -- 10.20.193.40:0/1497947058 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f646c01c360 con 0x7f647c16b8c0 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 1 --2- 10.20.193.40:0/1497947058 >> v2:10.20.193.120:6800/397309233 conn(0x7f64480742a0 0x7f6448094750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 1 -- 10.20.193.40:0/1497947058 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f646c096b10 con 0x7f647c16b8c0 2026-02-24T17:25:12.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 10 client.4650.objecter ms_dispatch2 0x7f647c000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 3 client.4650.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 3 client.4650.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f647a575640 1 --2- 10.20.193.40:0/1497947058 >> v2:10.20.193.120:6800/397309233 conn(0x7f64480742a0 0x7f6448094750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 20 client.4650.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f647a575640 1 --2- 10.20.193.40:0/1497947058 >> v2:10.20.193.120:6800/397309233 conn(0x7f64480742a0 0x7f6448094750 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c140d50 tx=0x7f6470008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 10 client.4650.objecter ms_handle_connect 0x7f64480742a0 2026-02-24T17:25:12.585 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.575+0000 7f6462ffd640 1 -- 10.20.193.40:0/1497947058 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f646c008e20 con 0x7f647c16b8c0 2026-02-24T17:25:12.675 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.663+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f647c140dc0 con 0x7f64480742a0 2026-02-24T17:25:12.676 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6462ffd640 1 -- 10.20.193.40:0/1497947058 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42562 (secure 0 0 0) 0x7f647c140dc0 con 0x7f64480742a0 2026-02-24T17:25:12.676 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:25:12.676 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 10 librados: watch_flush enter 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 10 librados: watch_flush exit 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 20 client.4650.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 10 client.4650.objecter successfully canceled tick 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 >> v2:10.20.193.120:6800/397309233 conn(0x7f64480742a0 msgr2=0x7f6448094750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 --2- 10.20.193.40:0/1497947058 >> v2:10.20.193.120:6800/397309233 conn(0x7f64480742a0 0x7f6448094750 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c140d50 tx=0x7f6470008040 comp rx=0 tx=0).stop 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c16b8c0 msgr2=0x7f647c057690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c16b8c0 0x7f647c057690 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f646c00dac0 tx=0x7f646c00df80 comp rx=0 tx=0).stop 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 shutdown_connections 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 --2- 10.20.193.40:0/1497947058 >> v2:10.20.193.120:6800/397309233 conn(0x7f64480742a0 0x7f6448094750 unknown :-1 s=CLOSED pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f647c16b8c0 0x7f647c057690 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f647c161c70 0x7f647c1425f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 --2- 10.20.193.40:0/1497947058 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f647c1618a0 0x7f647c1420b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 >> 10.20.193.40:0/1497947058 conn(0x7f647c0b8fd0 msgr2=0x7f647c0b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 shutdown_connections 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 -- 10.20.193.40:0/1497947058 wait complete. 2026-02-24T17:25:12.677 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.667+0000 7f6480a12640 1 librados: shutdown 2026-02-24T17:25:12.687 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-24T17:25:11.862007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":235,"num_write_kb":4762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":435756,"kb_used_data":4396,"kb_used_omap":152,"kb_used_meta":430951,"kb_avail":1509513684,"statfs":{"total":1546188226560,"available":1545742012416,"internally_reserved":0,"allocated":4501504,"data_stored":2802729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":156651,"internal_metadata":441293845},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.010867"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:09.854702+0000","last_change":"2026-02-24T17:25:09.854702+0000","last_active":"2026-02-24T17:25:09.854702+0000","last_peered":"2026-02-24T17:25:09.854702+0000","last_clean":"2026-02-24T17:25:09.854702+0000","last_became_active":"2026-02-24T17:25:08.378421+0000","last_became_peered":"2026-02-24T17:25:08.378421+0000","last_unstale":"2026-02-24T17:25:09.854702+0000","last_undegraded":"2026-02-24T17:25:09.854702+0000","last_fullsized":"2026-02-24T17:25:09.854702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:44.939627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.079278+0000","last_change":"2026-02-24T17:25:10.079278+0000","last_active":"2026-02-24T17:25:10.079278+0000","last_peered":"2026-02-24T17:25:10.079278+0000","last_clean":"2026-02-24T17:25:10.079278+0000","last_became_active":"2026-02-24T17:25:07.858311+0000","last_became_peered":"2026-02-24T17:25:07.858311+0000","last_unstale":"2026-02-24T17:25:10.079278+0000","last_undegraded":"2026-02-24T17:25:10.079278+0000","last_fullsized":"2026-02-24T17:25:10.079278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:29:45.741836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030397399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.081728+0000","last_change":"2026-02-24T17:25:10.081728+0000","last_active":"2026-02-24T17:25:10.081728+0000","last_peered":"2026-02-24T17:25:10.081728+0000","last_clean":"2026-02-24T17:25:10.081728+0000","last_became_active":"2026-02-24T17:25:08.084075+0000","last_became_peered":"2026-02-24T17:25:08.084075+0000","last_unstale":"2026-02-24T17:25:10.081728+0000","last_undegraded":"2026-02-24T17:25:10.081728+0000","last_fullsized":"2026-02-24T17:25:10.081728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:51:08.211087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000244684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.079275+0000","last_change":"2026-02-24T17:25:10.079275+0000","last_active":"2026-02-24T17:25:10.079275+0000","last_peered":"2026-02-24T17:25:10.079275+0000","last_clean":"2026-02-24T17:25:10.079275+0000","last_became_active":"2026-02-24T17:25:07.858281+0000","last_became_peered":"2026-02-24T17:25:07.858281+0000","last_unstale":"2026-02-24T17:25:10.079275+0000","last_undegraded":"2026-02-24T17:25:10.079275+0000","last_fullsized":"2026-02-24T17:25:10.079275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:14.965746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028402800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:09.855657+0000","last_change":"2026-02-24T17:25:09.855093+0000","last_active":"2026-02-24T17:25:09.855657+0000","last_peered":"2026-02-24T17:25:09.855657+0000","last_clean":"2026-02-24T17:25:09.855657+0000","last_became_active":"2026-02-24T17:25:08.074872+0000","last_became_peered":"2026-02-24T17:25:08.074872+0000","last_unstale":"2026-02-24T17:25:09.855657+0000","last_undegraded":"2026-02-24T17:25:09.855657+0000","last_fullsized":"2026-02-24T17:25:09.855657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:30:27.324702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089238299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.079008+0000","last_change":"2026-02-24T17:25:10.079008+0000","last_active":"2026-02-24T17:25:10.079008+0000","last_peered":"2026-02-24T17:25:10.079008+0000","last_clean":"2026-02-24T17:25:10.079008+0000","last_became_active":"2026-02-24T17:25:07.860331+0000","last_became_peered":"2026-02-24T17:25:07.860331+0000","last_unstale":"2026-02-24T17:25:10.079008+0000","last_undegraded":"2026-02-24T17:25:10.079008+0000","last_fullsized":"2026-02-24T17:25:10.079008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:34:57.054779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023849400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:09.854861+0000","last_change":"2026-02-24T17:25:09.854861+0000","last_active":"2026-02-24T17:25:09.854861+0000","last_peered":"2026-02-24T17:25:09.854861+0000","last_clean":"2026-02-24T17:25:09.854861+0000","last_became_active":"2026-02-24T17:25:08.184697+0000","last_became_peered":"2026-02-24T17:25:08.184697+0000","last_unstale":"2026-02-24T17:25:09.854861+0000","last_undegraded":"2026-02-24T17:25:09.854861+0000","last_fullsized":"2026-02-24T17:25:09.854861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:43:33.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064636800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.079028+0000","last_change":"2026-02-24T17:25:10.079028+0000","last_active":"2026-02-24T17:25:10.079028+0000","last_peered":"2026-02-24T17:25:10.079028+0000","last_clean":"2026-02-24T17:25:10.079028+0000","last_became_active":"2026-02-24T17:25:08.090187+0000","last_became_peered":"2026-02-24T17:25:08.090187+0000","last_unstale":"2026-02-24T17:25:10.079028+0000","last_undegraded":"2026-02-24T17:25:10.079028+0000","last_fullsized":"2026-02-24T17:25:10.079028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:14:10.801138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024157000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"25'192","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:11.284958+0000","last_change":"2026-02-24T17:25:04.114588+0000","last_active":"2026-02-24T17:25:11.284958+0000","last_peered":"2026-02-24T17:25:11.284958+0000","last_clean":"2026-02-24T17:25:11.284958+0000","last_became_active":"2026-02-24T17:25:04.113696+0000","last_became_peered":"2026-02-24T17:25:04.113696+0000","last_unstale":"2026-02-24T17:25:11.284958+0000","last_undegraded":"2026-02-24T17:25:11.284958+0000","last_fullsized":"2026-02-24T17:25:11.284958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_clean_scrub_stamp":"2026-02-24T17:25:02.798744+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:55:22.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27140,"kb_used_data":180,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":184320,"data_stored":98657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3,4,5,6,7,8,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":21,"seq":90194313221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":102796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[0,1,2,3,4,5,6,8,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":208,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":212992,"data_stored":102988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":188,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":192512,"data_stored":99872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[1,2,3,4,5,6,7,8,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":220,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":225280,"data_stored":103100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,2,3,4,7,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":102464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27156,"kb_used_data":196,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":200704,"data_stored":100738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10073,"internal_metadata":27580583},"hb_peers":[2,4,5,6,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":102399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[3,5,6,7,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":780,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":798720,"data_stored":692377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[2,4,6,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":776,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":794624,"data_stored":685326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9424,"internal_metadata":27581232},"hb_peers":[0,1,3,5,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":220,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":225280,"data_stored":103148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10070,"internal_metadata":27580586},"hb_peers":[0,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313220,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":102868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[1,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":192,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":196608,"data_stored":100916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9430,"internal_metadata":27581226},"hb_peers":[0,4,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":102009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10080,"internal_metadata":27580576},"hb_peers":[0,1,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":196,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":200704,"data_stored":101396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10076,"internal_metadata":27580580},"hb_peers":[0,1,2,3,4,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":101675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,2,3,4,5,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T17:25:12.687 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T17:25:12.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eac14a640 1 Processor -- start 2026-02-24T17:25:12.757 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eac14a640 1 -- start start 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eac14a640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f7ea405d1a0 0x7f7ea405d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eac14a640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f7ea416ada0 0x7f7ea4166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eac14a640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f7ea40bc470 0x7f7ea40b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eac14a640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea4167130 con 0x7f7ea40bc470 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eac14a640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea41673c0 con 0x7f7ea416ada0 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eac14a640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea41676a0 con 0x7f7ea405d1a0 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eaa6c0640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f7ea40bc470 0x7f7ea40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eaa6c0640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f7ea40bc470 0x7f7ea40b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60316/0 (socket says 10.20.193.40:60316) 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eaa6c0640 1 -- 10.20.193.40:0/2539702981 learned_addr learned my addr 10.20.193.40:0/2539702981 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7ea96be640 1 --2- 10.20.193.40:0/2539702981 >> v2:10.20.193.94:3300/0 conn(0x7f7ea416ada0 0x7f7ea4166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7ea9ebf640 1 --2- 10.20.193.40:0/2539702981 >> v2:10.20.193.109:3300/0 conn(0x7f7ea405d1a0 0x7f7ea405d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eaa6c0640 1 -- 10.20.193.40:0/2539702981 >> v2:10.20.193.109:3300/0 conn(0x7f7ea405d1a0 msgr2=0x7f7ea405d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eaa6c0640 1 --2- 10.20.193.40:0/2539702981 >> v2:10.20.193.109:3300/0 conn(0x7f7ea405d1a0 0x7f7ea405d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eaa6c0640 1 -- 10.20.193.40:0/2539702981 >> v2:10.20.193.94:3300/0 conn(0x7f7ea416ada0 msgr2=0x7f7ea4166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eaa6c0640 1 --2- 10.20.193.40:0/2539702981 >> v2:10.20.193.94:3300/0 conn(0x7f7ea416ada0 0x7f7ea4166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.758 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.747+0000 7f7eaa6c0640 1 -- 10.20.193.40:0/2539702981 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea4167980 con 0x7f7ea40bc470 2026-02-24T17:25:12.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eaa6c0640 1 --2- 10.20.193.40:0/2539702981 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea40bc470 0x7f7ea40b4f10 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=11575699848393367620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ea4161140 tx=0x7f7ea001d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a525ae7207a044 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea8ebd640 1 -- 10.20.193.40:0/2539702981 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ea00b3070 con 0x7f7ea40bc470 2026-02-24T17:25:12.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea8ebd640 1 -- 10.20.193.40:0/2539702981 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea00a6a00 con 0x7f7ea40bc470 2026-02-24T17:25:12.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea8ebd640 1 -- 10.20.193.40:0/2539702981 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ea00a6e10 con 0x7f7ea40bc470 2026-02-24T17:25:12.760 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- 10.20.193.40:0/2539702981 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea40bc470 msgr2=0x7f7ea40b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 --2- 10.20.193.40:0/2539702981 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea40bc470 0x7f7ea40b4f10 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=11575699848393367620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ea4161140 tx=0x7f7ea001d920 comp rx=0 tx=0).stop 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- 10.20.193.40:0/2539702981 shutdown_connections 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 --2- 10.20.193.40:0/2539702981 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea40bc470 0x7f7ea40b4f10 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=11575699848393367620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 --2- 10.20.193.40:0/2539702981 >> v2:10.20.193.94:3300/0 conn(0x7f7ea416ada0 0x7f7ea4166bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 --2- 10.20.193.40:0/2539702981 >> v2:10.20.193.109:3300/0 conn(0x7f7ea405d1a0 0x7f7ea405d570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- 10.20.193.40:0/2539702981 >> 10.20.193.40:0/2539702981 conn(0x7f7ea40bd200 msgr2=0x7f7ea40bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- 10.20.193.40:0/2539702981 shutdown_connections 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- 10.20.193.40:0/2539702981 wait complete. 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 librados: starting msgr at 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 librados: starting objecter 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 Processor -- start 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- start start 2026-02-24T17:25:12.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 librados: setting wanted keys 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 librados: calling monclient init 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea405d1a0 0x7f7ea417a830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7ea40bc470 0x7f7ea415ad40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7ea416ada0 0x7f7ea41793d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea415d860 con 0x7f7ea405d1a0 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea40b5860 con 0x7f7ea416ada0 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea415d9e0 con 0x7f7ea40bc470 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea405d1a0 0x7f7ea417a830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea405d1a0 0x7f7ea417a830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60332/0 (socket says 10.20.193.40:60332) 2026-02-24T17:25:12.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 -- 10.20.193.40:0/3612364138 learned_addr learned my addr 10.20.193.40:0/3612364138 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eaa6c0640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7ea416ada0 0x7f7ea41793d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea96be640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7ea40bc470 0x7f7ea415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 -- 10.20.193.40:0/3612364138 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7ea40bc470 msgr2=0x7f7ea415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7ea40bc470 0x7f7ea415ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 -- 10.20.193.40:0/3612364138 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7ea416ada0 msgr2=0x7f7ea41793d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7ea416ada0 0x7f7ea41793d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 -- 10.20.193.40:0/3612364138 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea4179ec0 con 0x7f7ea405d1a0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eaa6c0640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7ea416ada0 0x7f7ea41793d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7ea9ebf640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea405d1a0 0x7f7ea417a830 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e9400d7d0 tx=0x7f7e9400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7e927fc640 10 client.?.objecter ms_handle_connect 0x7f7ea405d1a0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7e927fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7e927fc640 1 -- 10.20.193.40:0/3612364138 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e94009af0 con 0x7f7ea405d1a0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7e927fc640 1 -- 10.20.193.40:0/3612364138 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e94019070 con 0x7f7ea405d1a0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7e927fc640 1 -- 10.20.193.40:0/3612364138 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e94014430 con 0x7f7ea405d1a0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea417a1a0 con 0x7f7ea405d1a0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 10 client.4656.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea4169350 con 0x7f7ea405d1a0 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.751+0000 7f7eac14a640 1 librados: init done 2026-02-24T17:25:12.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea405d570 con 0x7f7ea405d1a0 2026-02-24T17:25:12.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 1 -- 10.20.193.40:0/3612364138 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f7e94013070 con 0x7f7ea405d1a0 2026-02-24T17:25:12.764 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 1 --2- 10.20.193.40:0/3612364138 >> v2:10.20.193.120:6800/397309233 conn(0x7f7e74074100 0x7f7e740945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 1 -- 10.20.193.40:0/3612364138 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7f7e9400f040 con 0x7f7ea405d1a0 2026-02-24T17:25:12.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 10 client.4656.objecter ms_dispatch2 0x7f7ea4000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 3 client.4656.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 3 client.4656.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 20 client.4656.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7ea96be640 1 --2- 10.20.193.40:0/3612364138 >> v2:10.20.193.120:6800/397309233 conn(0x7f7e74074100 0x7f7e740945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 10 client.4656.objecter ms_handle_connect 0x7f7e74074100 2026-02-24T17:25:12.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7ea96be640 1 --2- 10.20.193.40:0/3612364138 >> v2:10.20.193.120:6800/397309233 conn(0x7f7e74074100 0x7f7e740945b0 secure :-1 s=READY pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ea417c8b0 tx=0x7f7e98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.755+0000 7f7e927fc640 1 -- 10.20.193.40:0/3612364138 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f7e940611a0 con 0x7f7ea405d1a0 2026-02-24T17:25:12.852 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ea403b110 con 0x7f7e74074100 2026-02-24T17:25:12.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7e927fc640 1 -- 10.20.193.40:0/3612364138 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42562 (secure 0 0 0) 0x7f7e98011970 con 0x7f7e74074100 2026-02-24T17:25:12.854 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:25:12.856 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-24T17:25:12.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 10 librados: watch_flush enter 2026-02-24T17:25:12.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 10 librados: watch_flush exit 2026-02-24T17:25:12.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 20 client.4656.objecter shutdown clearing up homeless session... 2026-02-24T17:25:12.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 10 client.4656.objecter successfully canceled tick 2026-02-24T17:25:12.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 >> v2:10.20.193.120:6800/397309233 conn(0x7f7e74074100 msgr2=0x7f7e740945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.856 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 --2- 10.20.193.40:0/3612364138 >> v2:10.20.193.120:6800/397309233 conn(0x7f7e74074100 0x7f7e740945b0 secure :-1 s=READY pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ea417c8b0 tx=0x7f7e98008040 comp rx=0 tx=0).stop 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea405d1a0 msgr2=0x7f7ea417a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea405d1a0 0x7f7ea417a830 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e9400d7d0 tx=0x7f7e9400dc90 comp rx=0 tx=0).stop 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 shutdown_connections 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 --2- 10.20.193.40:0/3612364138 >> v2:10.20.193.120:6800/397309233 conn(0x7f7e74074100 0x7f7e740945b0 unknown :-1 s=CLOSED pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7ea416ada0 0x7f7ea41793d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7ea40bc470 0x7f7ea415ad40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 --2- 10.20.193.40:0/3612364138 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7ea405d1a0 0x7f7ea417a830 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 >> 10.20.193.40:0/3612364138 conn(0x7f7ea40bd200 msgr2=0x7f7ea415b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 shutdown_connections 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 -- 10.20.193.40:0/3612364138 wait complete. 2026-02-24T17:25:12.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.843+0000 7f7eac14a640 1 librados: shutdown 2026-02-24T17:25:12.865 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-24T17:25:11.862007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":235,"num_write_kb":4762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":435756,"kb_used_data":4396,"kb_used_omap":152,"kb_used_meta":430951,"kb_avail":1509513684,"statfs":{"total":1546188226560,"available":1545742012416,"internally_reserved":0,"allocated":4501504,"data_stored":2802729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":156651,"internal_metadata":441293845},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.010867"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:09.854702+0000","last_change":"2026-02-24T17:25:09.854702+0000","last_active":"2026-02-24T17:25:09.854702+0000","last_peered":"2026-02-24T17:25:09.854702+0000","last_clean":"2026-02-24T17:25:09.854702+0000","last_became_active":"2026-02-24T17:25:08.378421+0000","last_became_peered":"2026-02-24T17:25:08.378421+0000","last_unstale":"2026-02-24T17:25:09.854702+0000","last_undegraded":"2026-02-24T17:25:09.854702+0000","last_fullsized":"2026-02-24T17:25:09.854702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:44.939627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.079278+0000","last_change":"2026-02-24T17:25:10.079278+0000","last_active":"2026-02-24T17:25:10.079278+0000","last_peered":"2026-02-24T17:25:10.079278+0000","last_clean":"2026-02-24T17:25:10.079278+0000","last_became_active":"2026-02-24T17:25:07.858311+0000","last_became_peered":"2026-02-24T17:25:07.858311+0000","last_unstale":"2026-02-24T17:25:10.079278+0000","last_undegraded":"2026-02-24T17:25:10.079278+0000","last_fullsized":"2026-02-24T17:25:10.079278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:29:45.741836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030397399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.081728+0000","last_change":"2026-02-24T17:25:10.081728+0000","last_active":"2026-02-24T17:25:10.081728+0000","last_peered":"2026-02-24T17:25:10.081728+0000","last_clean":"2026-02-24T17:25:10.081728+0000","last_became_active":"2026-02-24T17:25:08.084075+0000","last_became_peered":"2026-02-24T17:25:08.084075+0000","last_unstale":"2026-02-24T17:25:10.081728+0000","last_undegraded":"2026-02-24T17:25:10.081728+0000","last_fullsized":"2026-02-24T17:25:10.081728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:51:08.211087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000244684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.079275+0000","last_change":"2026-02-24T17:25:10.079275+0000","last_active":"2026-02-24T17:25:10.079275+0000","last_peered":"2026-02-24T17:25:10.079275+0000","last_clean":"2026-02-24T17:25:10.079275+0000","last_became_active":"2026-02-24T17:25:07.858281+0000","last_became_peered":"2026-02-24T17:25:07.858281+0000","last_unstale":"2026-02-24T17:25:10.079275+0000","last_undegraded":"2026-02-24T17:25:10.079275+0000","last_fullsized":"2026-02-24T17:25:10.079275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:14.965746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028402800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:09.855657+0000","last_change":"2026-02-24T17:25:09.855093+0000","last_active":"2026-02-24T17:25:09.855657+0000","last_peered":"2026-02-24T17:25:09.855657+0000","last_clean":"2026-02-24T17:25:09.855657+0000","last_became_active":"2026-02-24T17:25:08.074872+0000","last_became_peered":"2026-02-24T17:25:08.074872+0000","last_unstale":"2026-02-24T17:25:09.855657+0000","last_undegraded":"2026-02-24T17:25:09.855657+0000","last_fullsized":"2026-02-24T17:25:09.855657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:30:27.324702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089238299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.079008+0000","last_change":"2026-02-24T17:25:10.079008+0000","last_active":"2026-02-24T17:25:10.079008+0000","last_peered":"2026-02-24T17:25:10.079008+0000","last_clean":"2026-02-24T17:25:10.079008+0000","last_became_active":"2026-02-24T17:25:07.860331+0000","last_became_peered":"2026-02-24T17:25:07.860331+0000","last_unstale":"2026-02-24T17:25:10.079008+0000","last_undegraded":"2026-02-24T17:25:10.079008+0000","last_fullsized":"2026-02-24T17:25:10.079008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:34:57.054779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023849400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:09.854861+0000","last_change":"2026-02-24T17:25:09.854861+0000","last_active":"2026-02-24T17:25:09.854861+0000","last_peered":"2026-02-24T17:25:09.854861+0000","last_clean":"2026-02-24T17:25:09.854861+0000","last_became_active":"2026-02-24T17:25:08.184697+0000","last_became_peered":"2026-02-24T17:25:08.184697+0000","last_unstale":"2026-02-24T17:25:09.854861+0000","last_undegraded":"2026-02-24T17:25:09.854861+0000","last_fullsized":"2026-02-24T17:25:09.854861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:43:33.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064636800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:10.079028+0000","last_change":"2026-02-24T17:25:10.079028+0000","last_active":"2026-02-24T17:25:10.079028+0000","last_peered":"2026-02-24T17:25:10.079028+0000","last_clean":"2026-02-24T17:25:10.079028+0000","last_became_active":"2026-02-24T17:25:08.090187+0000","last_became_peered":"2026-02-24T17:25:08.090187+0000","last_unstale":"2026-02-24T17:25:10.079028+0000","last_undegraded":"2026-02-24T17:25:10.079028+0000","last_fullsized":"2026-02-24T17:25:10.079028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:14:10.801138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024157000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"25'192","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T17:25:11.284958+0000","last_change":"2026-02-24T17:25:04.114588+0000","last_active":"2026-02-24T17:25:11.284958+0000","last_peered":"2026-02-24T17:25:11.284958+0000","last_clean":"2026-02-24T17:25:11.284958+0000","last_became_active":"2026-02-24T17:25:04.113696+0000","last_became_peered":"2026-02-24T17:25:04.113696+0000","last_unstale":"2026-02-24T17:25:11.284958+0000","last_undegraded":"2026-02-24T17:25:11.284958+0000","last_fullsized":"2026-02-24T17:25:11.284958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_clean_scrub_stamp":"2026-02-24T17:25:02.798744+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:55:22.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27140,"kb_used_data":180,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":184320,"data_stored":98657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3,4,5,6,7,8,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":21,"seq":90194313221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":102796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[0,1,2,3,4,5,6,8,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":208,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":212992,"data_stored":102988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":188,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":192512,"data_stored":99872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[1,2,3,4,5,6,7,8,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":220,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":225280,"data_stored":103100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,2,3,4,7,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":102464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27156,"kb_used_data":196,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":200704,"data_stored":100738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10073,"internal_metadata":27580583},"hb_peers":[2,4,5,6,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":102399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[3,5,6,7,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":780,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":798720,"data_stored":692377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[2,4,6,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":776,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":794624,"data_stored":685326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9424,"internal_metadata":27581232},"hb_peers":[0,1,3,5,7,8,9,10,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313220,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":220,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":225280,"data_stored":103148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10070,"internal_metadata":27580586},"hb_peers":[0,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313220,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":216,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":221184,"data_stored":102868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[1,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":192,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":196608,"data_stored":100916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9430,"internal_metadata":27581226},"hb_peers":[0,4,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":200,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":204800,"data_stored":102009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10080,"internal_metadata":27580576},"hb_peers":[0,1,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":196,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":200704,"data_stored":101396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10076,"internal_metadata":27580580},"hb_peers":[0,1,2,3,4,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27164,"kb_used_data":204,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":208896,"data_stored":101675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,2,3,4,5,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T17:25:12.867 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T17:25:12.867 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T17:25:12.867 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-24T17:25:12.867 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-24T17:25:12.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfecb95640 1 Processor -- start 2026-02-24T17:25:12.938 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfecb95640 1 -- start start 2026-02-24T17:25:12.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfecb95640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbfe805df60 0x7fbfe8164910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfecb95640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe80b29c0 con 0x7fbfe80b1010 2026-02-24T17:25:12.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfecb95640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe80b1640 con 0x7fbfe815b110 2026-02-24T17:25:12.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfecb95640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe80b1920 con 0x7fbfe805df60 2026-02-24T17:25:12.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfe6d76640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbfe805df60 0x7fbfe8164910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfe5d74640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fbfe80b1010 0x7fbfe805d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:49370/0 (socket says 10.20.193.40:49370) 2026-02-24T17:25:12.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfe6d76640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbfe805df60 0x7fbfe8164910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60340/0 (socket says 10.20.193.40:60340) 2026-02-24T17:25:12.940 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfe5d74640 1 -- 10.20.193.40:0/2399553559 learned_addr learned my addr 10.20.193.40:0/2399553559 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:25:12.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfe6d76640 1 -- 10.20.193.40:0/2399553559 >> v1:10.20.193.94:6789/0 conn(0x7fbfe815b110 legacy=0x7fbfe80564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:12.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfe6d76640 1 -- 10.20.193.40:0/2399553559 >> v1:10.20.193.40:6789/0 conn(0x7fbfe80b1010 legacy=0x7fbfe805d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfe6d76640 1 -- 10.20.193.40:0/2399553559 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe80b1c00 con 0x7fbfe805df60 2026-02-24T17:25:12.941 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.927+0000 7fbfe5573640 1 -- 10.20.193.40:0/2399553559 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207203248 0 0) 0x7fbfe80b29c0 con 0x7fbfe80b1010 2026-02-24T17:25:12.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6d76640 1 --2- 10.20.193.40:0/2399553559 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe8164910 secure :-1 s=READY pgs=191 gs=3 cs=0 l=1 c_cookie=17458945761765266110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfd8005c90 tx=0x7fbfd801d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24aa2ab3ad492be server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe5573640 1 -- 10.20.193.40:0/2399553559 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfd80b3070 con 0x7fbfe805df60 2026-02-24T17:25:12.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe5573640 1 -- 10.20.193.40:0/2399553559 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd80a6690 con 0x7fbfe805df60 2026-02-24T17:25:12.945 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe5573640 1 -- 10.20.193.40:0/2399553559 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfd80a6aa0 con 0x7fbfe805df60 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- 10.20.193.40:0/2399553559 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 msgr2=0x7fbfe8164910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 --2- 10.20.193.40:0/2399553559 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe8164910 secure :-1 s=READY pgs=191 gs=3 cs=0 l=1 c_cookie=17458945761765266110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfd8005c90 tx=0x7fbfd801d8f0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- 10.20.193.40:0/2399553559 shutdown_connections 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 --2- 10.20.193.40:0/2399553559 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe8164910 unknown :-1 s=CLOSED pgs=191 gs=3 cs=0 l=1 c_cookie=17458945761765266110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- 10.20.193.40:0/2399553559 >> 10.20.193.40:0/2399553559 conn(0x7fbfe80b89b0 msgr2=0x7fbfe80b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- 10.20.193.40:0/2399553559 shutdown_connections 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- 10.20.193.40:0/2399553559 wait complete. 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 librados: starting msgr at 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 librados: starting objecter 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 Processor -- start 2026-02-24T17:25:12.946 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- start start 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 librados: setting wanted keys 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 librados: calling monclient init 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe817d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbfe80b1010 0x7fbfe805d0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbfe815b110 0x7fbfe8167760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe815b4e0 con 0x7fbfe805df60 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe8056bd0 con 0x7fbfe80b1010 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe815b660 con 0x7fbfe815b110 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe817d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe817d150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:60344/0 (socket says 10.20.193.40:60344) 2026-02-24T17:25:12.947 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 -- 10.20.193.40:0/694273378 learned_addr learned my addr 10.20.193.40:0/694273378 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:25:12.948 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6d76640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbfe815b110 0x7fbfe8167760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.948 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe5d74640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbfe80b1010 0x7fbfe805d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.948 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 -- 10.20.193.40:0/694273378 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbfe815b110 msgr2=0x7fbfe8167760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.948 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbfe815b110 0x7fbfe8167760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.948 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 -- 10.20.193.40:0/694273378 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbfe80b1010 msgr2=0x7fbfe805d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:12.948 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbfe80b1010 0x7fbfe805d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:12.948 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 -- 10.20.193.40:0/694273378 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe815d290 con 0x7fbfe805df60 2026-02-24T17:25:12.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfe6575640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe817d150 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfdc00c520 tx=0x7fbfdc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfceffd640 10 client.?.objecter ms_handle_connect 0x7fbfe805df60 2026-02-24T17:25:12.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:12.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfceffd640 1 -- 10.20.193.40:0/694273378 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfdc017070 con 0x7fbfe805df60 2026-02-24T17:25:12.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfceffd640 1 -- 10.20.193.40:0/694273378 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc006af0 con 0x7fbfe805df60 2026-02-24T17:25:12.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe8179680 con 0x7fbfe805df60 2026-02-24T17:25:12.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfceffd640 1 -- 10.20.193.40:0/694273378 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfdc007030 con 0x7fbfe805df60 2026-02-24T17:25:12.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 10 client.4665.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:12.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe8179c40 con 0x7fbfe805df60 2026-02-24T17:25:12.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 librados: init done 2026-02-24T17:25:12.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.931+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe8165660 con 0x7fbfe805df60 2026-02-24T17:25:12.950 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 1 -- 10.20.193.40:0/694273378 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fbfdc0071d0 con 0x7fbfe805df60 2026-02-24T17:25:12.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 1 --2- 10.20.193.40:0/694273378 >> v2:10.20.193.120:6800/397309233 conn(0x7fbfb4074100 0x7fbfb40945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:12.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 1 -- 10.20.193.40:0/694273378 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6733+0+0 (secure 0 0 0) 0x7fbfdc095cb0 con 0x7fbfe805df60 2026-02-24T17:25:12.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 10 client.4665.objecter ms_dispatch2 0x7fbfe8000ba0 osd_map(29..29 src has 1..29) 2026-02-24T17:25:12.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 3 client.4665.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T17:25:12.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 3 client.4665.objecter handle_osd_map decoding full epoch 29 2026-02-24T17:25:12.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 20 client.4665.objecter dump_active .. 0 homeless 2026-02-24T17:25:12.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfe5d74640 1 --2- 10.20.193.40:0/694273378 >> v2:10.20.193.120:6800/397309233 conn(0x7fbfb4074100 0x7fbfb40945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:12.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfe5d74640 1 --2- 10.20.193.40:0/694273378 >> v2:10.20.193.120:6800/397309233 conn(0x7fbfb4074100 0x7fbfb40945b0 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfe8167150 tx=0x7fbfd0007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:12.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 10 client.4665.objecter ms_handle_connect 0x7fbfb4074100 2026-02-24T17:25:12.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:12.935+0000 7fbfceffd640 1 -- 10.20.193.40:0/694273378 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fbfdc021070 con 0x7fbfe805df60 2026-02-24T17:25:13.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbfe81633a0 con 0x7fbfe805df60 2026-02-24T17:25:13.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfceffd640 1 -- 10.20.193.40:0/694273378 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbfdc05fad0 con 0x7fbfe805df60 2026-02-24T17:25:13.053 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:25:13.053 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T17:25:13.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 10 librados: watch_flush enter 2026-02-24T17:25:13.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 10 librados: watch_flush exit 2026-02-24T17:25:13.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 20 client.4665.objecter shutdown clearing up homeless session... 2026-02-24T17:25:13.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 10 client.4665.objecter successfully canceled tick 2026-02-24T17:25:13.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 >> v2:10.20.193.120:6800/397309233 conn(0x7fbfb4074100 msgr2=0x7fbfb40945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 --2- 10.20.193.40:0/694273378 >> v2:10.20.193.120:6800/397309233 conn(0x7fbfb4074100 0x7fbfb40945b0 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfe8167150 tx=0x7fbfd0007dc0 comp rx=0 tx=0).stop 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 msgr2=0x7fbfe817d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe817d150 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfdc00c520 tx=0x7fbfdc00c9e0 comp rx=0 tx=0).stop 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 shutdown_connections 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 --2- 10.20.193.40:0/694273378 >> v2:10.20.193.120:6800/397309233 conn(0x7fbfb4074100 0x7fbfb40945b0 unknown :-1 s=CLOSED pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbfe815b110 0x7fbfe8167760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbfe80b1010 0x7fbfe805d0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 --2- 10.20.193.40:0/694273378 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbfe805df60 0x7fbfe817d150 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 >> 10.20.193.40:0/694273378 conn(0x7fbfe80b89b0 msgr2=0x7fbfe8159450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 shutdown_connections 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 -- 10.20.193.40:0/694273378 wait complete. 2026-02-24T17:25:13.054 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:25:13.043+0000 7fbfecb95640 1 librados: shutdown 2026-02-24T17:25:13.064 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-24T17:25:13.064 INFO:teuthology.run_tasks:Running task workunit... 2026-02-24T17:25:13.090 INFO:tasks.workunit:Pulling workunits from ref 618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:25:13.090 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-24T17:25:13.091 DEBUG:teuthology.orchestra.run.trial120:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-24T17:25:13.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:25:13.097 INFO:teuthology.orchestra.run.trial120.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-24T17:25:13.097 DEBUG:teuthology.orchestra.run.trial120:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T17:25:13.144 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-24T17:25:13.145 DEBUG:teuthology.orchestra.run.trial120:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-24T17:25:13.191 INFO:tasks.workunit:timeout=3h 2026-02-24T17:25:13.191 INFO:tasks.workunit:cleanup=True 2026-02-24T17:25:13.192 DEBUG:teuthology.orchestra.run.trial120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 618c318a7a0b287ab5aeff207b7bf1d73ef45044 2026-02-24T17:25:13.242 INFO:tasks.workunit.client.0.trial120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-24T17:25:13.476 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:25:13.473+0000 7f09b3cb4640 -1 osd.7 29 handle_osd_map injecting map crc failure 2026-02-24T17:25:14.124 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:25:14.123+0000 7fed2bebc640 -1 osd.9 29 handle_osd_map injecting map crc failure 2026-02-24T17:25:35.166 INFO:tasks.workunit.client.0.trial120.stderr:Note: switching to '618c318a7a0b287ab5aeff207b7bf1d73ef45044'. 2026-02-24T17:25:35.166 INFO:tasks.workunit.client.0.trial120.stderr: 2026-02-24T17:25:35.166 INFO:tasks.workunit.client.0.trial120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-24T17:25:35.166 INFO:tasks.workunit.client.0.trial120.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr:state without impacting any branches by switching back to a branch. 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr: 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr: 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr: git switch -c 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr: 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr:Or undo this operation with: 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr: 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr: git switch - 2026-02-24T17:25:35.167 INFO:tasks.workunit.client.0.trial120.stderr: 2026-02-24T17:25:35.168 INFO:tasks.workunit.client.0.trial120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-24T17:25:35.168 INFO:tasks.workunit.client.0.trial120.stderr: 2026-02-24T17:25:35.168 INFO:tasks.workunit.client.0.trial120.stderr:HEAD is now at 618c318a7a0 Merge branch 'stretched-cluster' of https://github.com/leonidc/ceph into wip-yuri8-testing-2026-02-23-2128 2026-02-24T17:25:35.175 DEBUG:teuthology.orchestra.run.trial120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-24T17:25:35.220 INFO:tasks.workunit.client.0.trial120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-24T17:25:35.221 INFO:tasks.workunit.client.0.trial120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T17:25:35.221 INFO:tasks.workunit.client.0.trial120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-24T17:25:35.321 INFO:tasks.workunit.client.0.trial120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-24T17:25:35.354 INFO:tasks.workunit.client.0.trial120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-24T17:25:35.379 INFO:tasks.workunit.client.0.trial120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T17:25:35.380 INFO:tasks.workunit.client.0.trial120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T17:25:35.380 INFO:tasks.workunit.client.0.trial120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-24T17:25:35.403 INFO:tasks.workunit.client.0.trial120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T17:25:35.407 DEBUG:teuthology.orchestra.run.trial120:> set -ex 2026-02-24T17:25:35.407 DEBUG:teuthology.orchestra.run.trial120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-24T17:25:35.452 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-24T17:25:35.455 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-24T17:25:35.455 DEBUG:teuthology.orchestra.run.trial120:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=618c318a7a0b287ab5aeff207b7bf1d73ef45044 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-24T17:25:35.505 INFO:tasks.workunit.client.0.trial120.stderr:+ RADOS_TESTS=(api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel) 2026-02-24T17:25:35.505 INFO:tasks.workunit.client.0.trial120.stderr:+ NEORADOS_TESTS=(cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations) 2026-02-24T17:25:35.505 INFO:tasks.workunit.client.0.trial120.stderr:+ parallel=1 2026-02-24T17:25:35.505 INFO:tasks.workunit.client.0.trial120.stderr:+ crimson=0 2026-02-24T17:25:35.505 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' '' = --serial ']' 2026-02-24T17:25:35.505 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' '' = --crimson ']' 2026-02-24T17:25:35.505 INFO:tasks.workunit.client.0.trial120.stderr:+ timeout=5400 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' '' = --timeout ']' 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ color= 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -t 1 ']' 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ vstart=0 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' '' = --vstart ']' 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ declare -A pids 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ declare -A test_type 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ ret=0 2026-02-24T17:25:35.506 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.507 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.507 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_aio 2026-02-24T17:25:35.507 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.507 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.507 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_aio 2026-02-24T17:25:35.507 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_aio' 2026-02-24T17:25:35.508 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_aio 2026-02-24T17:25:35.508 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.508 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_aio 2026-02-24T17:25:35.508 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20225 2026-02-24T17:25:35.508 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_aio on pid 20225' 2026-02-24T17:25:35.509 INFO:tasks.workunit.client.0.trial120.stdout:test api_aio on pid 20225 2026-02-24T17:25:35.510 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20225 2026-02-24T17:25:35.510 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.510 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.510 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_aio_pp 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_aio_pp 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_aio_pp' 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.511 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_aio_pp 2026-02-24T17:25:35.512 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.512 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-24T17:25:35.512 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-24T17:25:35.512 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_aio: /' 2026-02-24T17:25:35.512 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_aio_pp 2026-02-24T17:25:35.513 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20233 2026-02-24T17:25:35.513 INFO:tasks.workunit.client.0.trial120.stdout:test api_aio_pp on pid 20233 2026-02-24T17:25:35.514 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_aio_pp on pid 20233' 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20233 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_io 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_io 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_io' 2026-02-24T17:25:35.515 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_io 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_io 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20241 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_io on pid 20241' 2026-02-24T17:25:35.516 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20241 2026-02-24T17:25:35.517 INFO:tasks.workunit.client.0.trial120.stdout:test api_io on pid 20241 2026-02-24T17:25:35.518 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.518 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_io_pp 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_io_pp 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_io_pp' 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_io_pp 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.519 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.520 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-24T17:25:35.520 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_io: /' 2026-02-24T17:25:35.520 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_io.log 2026-02-24T17:25:35.520 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_io_pp 2026-02-24T17:25:35.520 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20249 2026-02-24T17:25:35.520 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_io_pp on pid 20249' 2026-02-24T17:25:35.521 INFO:tasks.workunit.client.0.trial120.stdout:test api_io_pp on pid 20249 2026-02-24T17:25:35.524 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20249 2026-02-24T17:25:35.524 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.525 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.525 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_asio 2026-02-24T17:25:35.525 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.525 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.525 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-24T17:25:35.525 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_asio 2026-02-24T17:25:35.525 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_asio' 2026-02-24T17:25:35.526 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.526 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.526 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.526 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.526 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.526 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_asio 2026-02-24T17:25:35.527 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-24T17:25:35.527 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-24T17:25:35.527 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-24T17:25:35.527 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_asio 2026-02-24T17:25:35.527 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20257 2026-02-24T17:25:35.527 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_asio on pid 20257' 2026-02-24T17:25:35.528 INFO:tasks.workunit.client.0.trial120.stdout:test api_asio on pid 20257 2026-02-24T17:25:35.532 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20257 2026-02-24T17:25:35.532 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.532 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.532 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_list 2026-02-24T17:25:35.533 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.533 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.533 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-24T17:25:35.533 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_list 2026-02-24T17:25:35.533 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_list' 2026-02-24T17:25:35.534 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_list 2026-02-24T17:25:35.534 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.534 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.534 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.534 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.534 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.534 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-24T17:25:35.535 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-24T17:25:35.535 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_asio: /' 2026-02-24T17:25:35.535 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_list 2026-02-24T17:25:35.535 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20265 2026-02-24T17:25:35.535 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_list on pid 20265' 2026-02-24T17:25:35.536 INFO:tasks.workunit.client.0.trial120.stdout:test api_list on pid 20265 2026-02-24T17:25:35.539 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20265 2026-02-24T17:25:35.539 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.539 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.539 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_lock 2026-02-24T17:25:35.539 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.539 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.540 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-24T17:25:35.540 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_lock 2026-02-24T17:25:35.540 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_lock' 2026-02-24T17:25:35.540 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_lock 2026-02-24T17:25:35.540 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.540 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.540 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.540 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.541 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.541 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-24T17:25:35.541 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_list.log 2026-02-24T17:25:35.541 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_list: /' 2026-02-24T17:25:35.541 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_lock 2026-02-24T17:25:35.541 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20273 2026-02-24T17:25:35.542 INFO:tasks.workunit.client.0.trial120.stdout:test api_lock on pid 20273 2026-02-24T17:25:35.544 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_lock on pid 20273' 2026-02-24T17:25:35.544 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20273 2026-02-24T17:25:35.545 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.545 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.545 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_lock_pp 2026-02-24T17:25:35.545 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.545 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.545 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-24T17:25:35.545 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_lock_pp 2026-02-24T17:25:35.545 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_lock_pp' 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_lock_pp 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-24T17:25:35.546 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_lock: /' 2026-02-24T17:25:35.547 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_lock_pp 2026-02-24T17:25:35.547 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20288 2026-02-24T17:25:35.547 INFO:tasks.workunit.client.0.trial120.stdout:test api_lock_pp on pid 20288 2026-02-24T17:25:35.549 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_lock_pp on pid 20288' 2026-02-24T17:25:35.549 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20288 2026-02-24T17:25:35.549 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.549 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_misc 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_misc 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_misc' 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_misc 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.550 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.551 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.551 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.551 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.551 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-24T17:25:35.551 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-24T17:25:35.551 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-24T17:25:35.551 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_misc 2026-02-24T17:25:35.551 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20303 2026-02-24T17:25:35.552 INFO:tasks.workunit.client.0.trial120.stdout:test api_misc on pid 20303 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_misc on pid 20303' 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20303 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_misc_pp 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_misc_pp 2026-02-24T17:25:35.554 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_misc_pp' 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_misc_pp 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_misc: /' 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_misc_pp 2026-02-24T17:25:35.555 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20326 2026-02-24T17:25:35.556 INFO:tasks.workunit.client.0.trial120.stdout:test api_misc_pp on pid 20326 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_misc_pp on pid 20326' 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20326 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_pool 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_pool 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_pool' 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_pool 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.557 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.558 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.558 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-24T17:25:35.558 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-24T17:25:35.558 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-24T17:25:35.558 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_pool 2026-02-24T17:25:35.558 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20362 2026-02-24T17:25:35.558 INFO:tasks.workunit.client.0.trial120.stdout:test api_pool on pid 20362 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_pool on pid 20362' 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20362 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_snapshots 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_snapshots 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_snapshots' 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_snapshots 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-24T17:25:35.559 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_pool: /' 2026-02-24T17:25:35.560 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_snapshots 2026-02-24T17:25:35.560 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20379 2026-02-24T17:25:35.560 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_snapshots on pid 20379' 2026-02-24T17:25:35.560 INFO:tasks.workunit.client.0.trial120.stdout:test api_snapshots on pid 20379 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20379 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_snapshots_pp 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_snapshots_pp 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_snapshots_pp' 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_snapshots_pp 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_snapshots_pp 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20388 2026-02-24T17:25:35.561 INFO:tasks.workunit.client.0.trial120.stdout:test api_snapshots_pp on pid 20388 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_snapshots_pp on pid 20388' 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20388 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_stat 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_stat 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_stat' 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_stat 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-24T17:25:35.562 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_stat 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20403 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stdout:test api_stat on pid 20403 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_stat on pid 20403' 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20403 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_stat_pp 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_stat_pp 2026-02-24T17:25:35.563 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_stat_pp' 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_stat_pp 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_stat: /' 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_stat_pp 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20428 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_stat_pp on pid 20428' 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stdout:test api_stat_pp on pid 20428 2026-02-24T17:25:35.564 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20428 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_watch_notify 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_watch_notify 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_watch_notify' 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_watch_notify 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_watch_notify 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20450 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_watch_notify on pid 20450' 2026-02-24T17:25:35.565 INFO:tasks.workunit.client.0.trial120.stdout:test api_watch_notify on pid 20450 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20450 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_watch_notify_pp 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_watch_notify_pp 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_watch_notify_pp' 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_watch_notify_pp 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_watch_notify_pp 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20470 2026-02-24T17:25:35.566 INFO:tasks.workunit.client.0.trial120.stdout:test api_watch_notify_pp on pid 20470 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_watch_notify_pp on pid 20470' 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20470 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_cmd 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_cmd 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_cmd' 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_cmd 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_cmd 2026-02-24T17:25:35.567 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20493 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stdout:test api_cmd on pid 20493 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_cmd on pid 20493' 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20493 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_cmd_pp 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_cmd_pp 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_cmd_pp' 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_cmd_pp 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.568 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_cmd: /' 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_cmd_pp 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20526 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stdout:test api_cmd_pp on pid 20526 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_cmd_pp on pid 20526' 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20526 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_service 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_service 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_service' 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_service 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.569 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [----------] Global test environment set-up. 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.545+0000 7f9ca4710980 1 Processor -- start 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.545+0000 7f9ca4710980 1 -- start start 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 0x56410f32bb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f22e020 0x56410f32c060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f322450 0x56410f31bce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x56410f1c8b20 con 0x56410f22d540 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x56410f1444f0 con 0x56410f322450 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x56410f1569b0 con 0x56410f22e020 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca29e9640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f322450 0x56410f31bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca21e8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 0x56410f32bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca29e9640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f322450 0x56410f31bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:58632/0 (socket says 10.20.193.120:58632) 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca29e9640 1 -- 10.20.193.120:0/2717905147 learned_addr learned my addr 10.20.193.120:0/2717905147 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f22e020 0x56410f32c060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca29e9640 1 -- 10.20.193.120:0/2717905147 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f22e020 msgr2=0x56410f32c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca29e9640 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f22e020 0x56410f32c060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_service 2026-02-24T17:25:35.570 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20562 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02test api_service on pid 20562 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_service on pid 20562' 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20562 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_service_pp 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_service_pp 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout:-24T17:25:35.549+0000 7f9ca29e9640 1 -- 10.20.193.120:0/2717905147 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 msgr2=0x56410f32bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca29e9640 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 0x56410f32bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca29e9640 1 -- 10.20.193.120:0/2717905147 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56410f13d590 con 0x56410f322450 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f22e020 0x56410f32c060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca29e9640 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f322450 0x56410f31bce0 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=4635800084118125304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c9401c120 tx=0x7f9c940044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4055ab9d6f963af8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca09e5640 1 -- 10.20.193.120:0/2717905147 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c940ab870 con 0x56410f322450 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca09e5640 1 -- 10.20.193.120:0/2717905147 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c940aba10 con 0x56410f322450 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca09e5640 1 -- 10.20.193.120:0/2717905147 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c940abde0 con 0x56410f322450 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- 10.20.193.120:0/2717905147 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f322450 msgr2=0x56410f31bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f322450 0x56410f31bce0 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=4635800084118125304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c9401c120 tx=0x7f9c940044c0 comp rx=0 tx=0).stop 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- 10.20.193.120:0/2717905147 shutdown_connections 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f322450 0x56410f31bce0 unknown :-1 s=CLOSED pgs=105 gs=3 cs=0 l=1 c_cookie=4635800084118125304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f22e020 0x56410f32c060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:35.571 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- 10.20.193.120:0/2717905147 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 0x56410f32bb20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_service_pp' 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_service_pp 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_service.log 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- 10.20.193.120:0/2717905147 >> 10.20.193.120:0/2717905147 conn(0x56410f2b56f0 msgr2=0x56410f2d5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- 10.20.193.120:0/2717905147 shutdown_connections 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- 10.20.193.120:0/2717905147 wait complete. 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 librados: starting msgr at 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 librados: starting objecter 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 Processor -- start 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- start start 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 librados: setting wanted keys 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 librados: calling monclient init 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 0x56410f32cc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f22e020 0x56410f31bce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f322450 0x56410f32d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:35.572 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x56410f31c4c0 con 0x56410f22d540 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x56410f31c340 con 0x56410f22e020 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca4710980 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x56410f31c640 con 0x56410f322450 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f22e020 0x56410f31bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca21e8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 0x56410f32cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f22e020 0x56410f31bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.120:58672/0 (socket says 10.20.193.120:58672) 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 -- 10.20.193.120:0/4258064095 learned_addr learned my addr 10.20.193.120:0/4258064095 (peer_addr_for_me v2:10.20.193.120:0/0) 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 -- 10.20.193.120:0/4258064095 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f322450 msgr2=0x56410f32d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_service: /' 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 --2- 10.20.193.120:0/4258064095 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x56410f322450 0x56410f32d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 rectest api_service_pp on pid 20592 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_service_pp 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20592 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_service_pp on pid 20592' 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20592 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_c_write_operations 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.573 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_c_write_operations 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_c_write_operations' 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_c_write_operations 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout:onnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 -- 10.20.193.120:0/4258064095 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 msgr2=0x56410f32cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 --2- 10.20.193.120:0/4258064095 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x56410f22d540 0x56410f32cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 -- 10.20.193.120:0/4258064095 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56410f331de0 con 0x56410f22e020 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9ca19e7640 1 --2- 10.20.193.120:0/4258064095 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f22e020 0x56410f31bce0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c8c001480 tx=0x7f9c8c00b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9c937fe640 10 client.?.objecter ms_handle_connect 0x56410f22e020 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.549+0000 7f9c937fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c8c017470 con 0x56410f22e020 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c012070 con 0x56410f22e020 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56410f3320d0 con 0x56410f22e020 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 10 client.4681.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c8c017830 con 0x56410f22e020 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56410f332610 con 0x56410f22e020 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 1 librados: init done 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 10 librados: wait_for_osdmap waiting 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f9c8c0203f0 con 0x56410f22e020 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 1 --2- 10.20.193.120:0/4258064095 >> v2:10.20.193.120:6800/397309233 conn(0x7f9c80072ac0 0x7f9c80092f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca21e8640 1 --2- 10.20.193.120:0/4258064095 >> v2:10.20.193.120:6800/397309233 conn(0x7f9c80072ac0 0x7f9c80092f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:35.574 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6705+0+0 (secure 0 0 0) 0x7f9c8c094dd0 con 0x56410f22e020 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_c_write_operations 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20624 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.5test api_c_write_operations on pid 20624 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_c_write_operations on pid 20624' 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20624 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_api_c_read_operations 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s api_c_read_operations 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' api_c_read_operations' 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:++ echo api_c_read_operations 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.575 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stdout:test api_c_read_operations on pid 20648 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=api_c_read_operations 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20648 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test api_c_read_operations on pid 20648' 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20648 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_list_parallel 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s list_parallel 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' list_parallel' 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:++ echo list_parallel 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.576 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=list_parallel 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stdout:test list_parallel on pid 20675 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20675 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test list_parallel on pid 20675' 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20675 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_open_pools_parallel 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s open_pools_parallel 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' open_pools_parallel' 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.577 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:++ echo open_pools_parallel 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ list_parallel: /' 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=open_pools_parallel 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stdout:test open_pools_parallel on pid 20719 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20719 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test open_pools_parallel on pid 20719' 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20719 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_rados_delete_pools_parallel 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s delete_pools_parallel 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' delete_pools_parallel' 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:++ echo delete_pools_parallel 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.578 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stdout:test delete_pools_parallel on pid 20739 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=delete_pools_parallel 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20739 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test delete_pools_parallel on pid 20739' 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20739 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=rados 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_cls 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s cls 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' cls' 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.579 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:++ echo cls 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stdout:test cls on pid 20760 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=cls 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20760 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test cls on pid 20760' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20760 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_cmd 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_cls.xml 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s cmd 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' cmd' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:++ echo cmd 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.580 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_cls --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_cls.xml 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_cls.log 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ cls: /' 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stdout:test cmd on pid 20778 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=cmd 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20778 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test cmd on pid 20778' 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20778 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_handler_error 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_cmd.xml 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s handler_error 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' handler_error' 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:++ echo handler_error 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.581 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_cmd.xml 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ cmd: /' 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=handler_error 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20796 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stdout:test handler_error on pid 20796 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test handler_error on pid 20796' 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20796 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_io 2026-02-24T17:25:35.582 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_handler_error.xml 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s io 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' io' 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:++ echo io 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_handler_error --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_handler_error.xml 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ handler_error: /' 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=io 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20807 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test io on pid 20807' 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stdout:test io on pid 20807 2026-02-24T17:25:35.583 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20807 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_ec_io 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_io.xml 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s ec_io 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' ec_io' 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:++ echo ec_io 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_io.xml 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_io.log 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ io: /' 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stdout:test ec_io on pid 20823 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=ec_io 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20823 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test ec_io on pid 20823' 2026-02-24T17:25:35.584 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20823 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_list 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_ec_io.xml 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s list 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' list' 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:++ echo list 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_ec_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_ec_io.xml 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ ec_io: /' 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stdout:test list on pid 20862 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=list 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20862 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test list on pid 20862' 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20862 2026-02-24T17:25:35.585 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_ec_list 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_list.xml 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s ec_list 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' ec_list' 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:++ echo ec_list 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_list.xml 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_list.log 2026-02-24T17:25:35.586 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ list: /' 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=ec_list 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20918 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stdout:test ec_list on pid 20918 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test ec_list on pid 20918' 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20918 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_misc 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.587 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_ec_list.xml 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s misc 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' misc' 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:++ echo misc 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_ec_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_ec_list.xml 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-24T17:25:35.588 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ ec_list: /' 2026-02-24T17:25:35.589 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=misc 2026-02-24T17:25:35.589 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20958 2026-02-24T17:25:35.589 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test misc on pid 20958' 2026-02-24T17:25:35.589 INFO:tasks.workunit.client.0.trial120.stdout:test misc on pid 20958 2026-02-24T17:25:35.589 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=20958 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_pool 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s pool 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_misc.xml 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' pool' 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:++ echo pool 2026-02-24T17:25:35.590 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.591 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.591 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.591 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.591 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.591 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_misc.xml 2026-02-24T17:25:35.591 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_misc.log 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ misc: /' 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stdout:test pool on pid 21008 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=pool 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21008 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test pool on pid 21008' 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=21008 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_read_operations 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.592 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_pool.xml 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s read_operations 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' read_operations' 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:++ echo read_operations 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_pool.xml 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_pool.log 2026-02-24T17:25:35.593 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ pool: /' 2026-02-24T17:25:35.594 INFO:tasks.workunit.client.0.trial120.stdout:test read_operations on pid 21026 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=read_operations 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21026 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test read_operations on pid 21026' 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=21026 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_snapshots 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_read_operations.xml 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s snapshots 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' snapshots' 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:++ echo snapshots 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.595 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.596 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.596 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_read_operations.xml 2026-02-24T17:25:35.596 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-24T17:25:35.596 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ read_operations: /' 2026-02-24T17:25:35.597 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=snapshots 2026-02-24T17:25:35.597 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21062 2026-02-24T17:25:35.597 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test snapshots on pid 21062' 2026-02-24T17:25:35.597 INFO:tasks.workunit.client.0.trial120.stdout:test snapshots on pid 21062 2026-02-24T17:25:35.597 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=21062 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_watch_notify 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_snapshots.xml 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s watch_notify 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' watch_notify' 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:++ echo watch_notify 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.598 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_snapshots.xml 2026-02-24T17:25:35.599 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-24T17:25:35.599 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ snapshots: /' 2026-02-24T17:25:35.600 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=watch_notify 2026-02-24T17:25:35.600 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21092 2026-02-24T17:25:35.600 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test watch_notify on pid 21092' 2026-02-24T17:25:35.600 INFO:tasks.workunit.client.0.trial120.stdout:test watch_notify on pid 21092 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=21092 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ executable=ceph_test_neorados_write_operations 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_watch_notify.xml 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:++ printf %25s write_operations 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ r=' write_operations' 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:++ echo write_operations 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:++ awk '{print $1}' 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_watch_notify.xml 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-24T17:25:35.601 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ watch_notify: /' 2026-02-24T17:25:35.602 INFO:tasks.workunit.client.0.trial120.stderr:+ ff=write_operations 2026-02-24T17:25:35.602 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21107 2026-02-24T17:25:35.602 INFO:tasks.workunit.client.0.trial120.stdout:test write_operations on pid 21107 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'test write_operations on pid 21107' 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ pids[$f]=21107 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ test_type["$f"]=neorados 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_write_operations.xml 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20257 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_asio (PID 20257)...' 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_asio (PID 20257)... 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20257 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' -z '' ']' 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ case $- in 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ return 2026-02-24T17:25:35.603 INFO:tasks.workunit.client.0.trial120.stderr:+ ceph_test_neorados_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/neorados_write_operations.xml 2026-02-24T17:25:35.604 INFO:tasks.workunit.client.0.trial120.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-24T17:25:35.604 INFO:tasks.workunit.client.0.trial120.stderr:+ sed 's/^/ write_operations: /' 2026-02-24T17:25:35.900 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:25:35.892+0000 7fbba8012640 -1 osd.12 30 handle_osd_map injecting map crc failure 2026-02-24T17:25:35.902 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:25:35.899+0000 7f8fc2cb5640 -1 osd.13 30 handle_osd_map injecting map crc failure 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout:53+0000 7f9c937fe640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_map(30..30 src has 1..30) 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 3 client.4681.objecter handle_osd_map got epochs [30,30] > 0 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 3 client.4681.objecter handle_osd_map decoding full epoch 30 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 20 client.4681.objecter dump_active .. 0 homeless 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 10 librados: wait_for_osdmap done waiting 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c94003420 con 0x56410f22e020 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca21e8640 1 --2- 10.20.193.120:0/4258064095 >> v2:10.20.193.120:6800/397309233 conn(0x7f9c80072ac0 0x7f9c80092f70 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c98002fa0 tx=0x7f9c9800d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 10 client.4681.objecter ms_handle_connect 0x7f9c80072ac0 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9c8c05b030 con 0x56410f22e020 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9c93fff640 10 client.4681.objecter _get_latest_version latest 30, have it 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 10 client.4681.objecter create_pool name=ceph_test_rados_api_asio 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 10 client.4681.objecter pool_op_submit 1 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.553+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x56410f13cbf0 con 0x56410f22e020 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== mon.1 v2:10.20.193.94:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v31) ==== 43+0+0 (secure 0 0 0) 0x7f9c8c005040 con 0x56410f22e020 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 pool_op_reply(tid 1 (0) Success v31) 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 10 client.4681.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v31) 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 10 client.4681.objecter have request 1 at 0x56410f322290 Op: create 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 20 client.4681.objecter waiting for client to reach epoch 31 before calling back 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 10 client.4681.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=31}) -- 0x7f9c80098340 con 0x56410f22e020 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 10 client.4681.objecter done 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== mon.1 v2:10.20.193.94:3300/0 8 ==== osd_map(31..31 src has 1..31) ==== 13374+0+0 (secure 0 0 0) 0x7f9c8c093000 con 0x56410f22e020 2026-02-24T17:25:35.905 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_map(31..31 src has 1..31) 2026-02-24T17:25:35.906 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 3 client.4681.objecter handle_osd_map got epochs [31,31] > 30 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 3 client.4681.objecter handle_osd_map decoding incremental epoch 31 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 20 client.4681.objecter dump_active .. 0 homeless 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 10 librados: set snap read head -> 1 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 10 librados: writefull oid=exist nspace= 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=writefull 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f333df0 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 31 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 1 --2- 10.20.193.120:0/4258064095 >> v2:10.20.193.94:6808/2000550170 conn(0x56410f3347b0 0x56410f334bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:25:35.922 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [writefull 0~5 in=5b] tid 2 osd.1 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 2 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 15 client.4681.objecter _send_op 2 to 15.1 on osd.1 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:2 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56410f3350f0 con 0x56410f3347b0 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca29e9640 1 --2- 10.20.193.120:0/4258064095 >> v2:10.20.193.94:6808/2000550170 conn(0x56410f3347b0 0x56410f334bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9ca29e9640 1 --2- 10.20.193.120:0/4258064095 >> v2:10.20.193.94:6808/2000550170 conn(0x56410f3347b0 0x56410f334bb0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:25:35.923 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.901+0000 7f9c937fe640 10 client.4681.objecter ms_handle_connect 0x56410f3347b0 2026-02-24T17:25:35.924 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.917+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 1 ==== osd_backoff(15.1 block id 1 [15:80000000::::0,15:88000000::::head) e31) ==== 115+0+0 (crc 0 0 0) 0x7f9c940a9070 con 0x56410f3347b0 2026-02-24T17:25:36.913 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:25:36.911+0000 7fb7ce2dd640 -1 osd.5 31 handle_osd_map injecting map crc failure 2026-02-24T17:25:36.962 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.917+0000 7f9c937fe640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_backoff(15.1 block id 1 [15:80000000::::0,15:88000000::::head) e31) 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.917+0000 7f9c937fe640 10 client.4681.objecter handle_osd_backoff osd_backoff(15.1 block id 1 [15:80000000::::0,15:88000000::::head) e31) 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.917+0000 7f9c937fe640 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.917+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_backoff(15.1 ack-block id 1 [15:80000000::::0,15:88000000::::head) e31) -- 0x7f9c800b6fd0 con 0x56410f3347b0 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:35.917+0000 7f9c937fe640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 2 ==== osd_backoff(15.1 unblock id 1 [15:80000000::::0,15:88000000::::head) e32) ==== 115+0+0 (crc 0 0 0) 0x7f9c800b6fd0 con 0x56410f3347b0 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_backoff(15.1 unblock id 1 [15:80000000::::0,15:88000000::::head) e32) 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 10 client.4681.objecter handle_osd_backoff osd_backoff(15.1 unblock id 1 [15:80000000::::0,15:88000000::::head) e32) 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 10 client.4681.objecter handle_osd_backoff unblock backoff 15.1 id 1 [15:80000000::::0,15:88000000::::head) 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 20 client.4681.objecter handle_osd_backoff contained_by 1 on 15:8049a5cb:::exist:head 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 15 client.4681.objecter _send_op 2 to 15.1 on osd.1 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:2 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e31) -- 0x7f9c800b7280 con 0x56410f3347b0 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.912+0000 7f9c937fe640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 3 ==== osd_map(32..32 src has 1..32) ==== 8440+0+0 (crc 0 0 0) 0x7f9c940b1040 con 0x56410f3347b0 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_map(32..32 src has 1..32) 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 3 client.4681.objecter handle_osd_map got epochs [32,32] > 31 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 3 client.4681.objecter handle_osd_map decoding incremental epoch 32 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 10 client.4681.objecter checking op 2 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 20 client.4681.objecter dump_active .. 0 homeless 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.920+0000 7f9c937fe640 20 client.4681.objecter 2 15.d3a59201 osd.1 exist [writefull 0~5 in=5b] 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 4 ==== osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 2 ondisk uv 1 in 15.1 attempt 1 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 2 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 2 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 2 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 librados: Objecter returned from writefull r=0 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f332f90 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.963 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~256] tid 3 osd.1 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 3 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _send_op 3 to 15.1 on osd.1 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:3 15.1 15:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f333440 con 0x56410f3347b0 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f333870 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~256] tid 4 osd.1 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 4 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _send_op 4 to 15.1 on osd.1 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:4 15.1 15:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f333d20 con 0x56410f3347b0 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 5 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.964 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 3 ondisk uv 1 in 15.1 attempt 0 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 3 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 3 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 3 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 6 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 4 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 4 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 4 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 4 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (0 ms) 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f333870 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~256] tid 5 osd.1 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 5 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _send_op 5 to 15.1 on osd.1 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:5 15.1 15:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f332f90 con 0x56410f3347b0 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f335490 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.965 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~256] tid 6 osd.1 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 6 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _send_op 6 to 15.1 on osd.1 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:6 15.1 15:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f335940 con 0x56410f3347b0 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 7 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 5 ondisk uv 1 in 15.1 attempt 0 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 5 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 5 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 5 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 8 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 6 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 6 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 6 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 6 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (0 ms) 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f335490 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~256] tid 7 osd.1 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 7 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _send_op 7 to 15.1 on osd.1 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:7 15.1 15:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f333870 con 0x56410f3347b0 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.966 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f335ee0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~256] tid 8 osd.1 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 8 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 15 client.4681.objecter _send_op 8 to 15.1 on osd.1 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:8 15.1 15:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f336390 con 0x56410f3347b0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.956+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 9 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 7 ondisk uv 1 in 15.1 attempt 0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 7 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 7 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 7 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 10 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 8 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 8 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 8 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 8 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f335ee0 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~256] tid 9 osd.1 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.967 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 9 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _send_op 9 to 15.1 on osd.1 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:9 15.1 15:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f3355a0 con 0x56410f3347b0 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f336780 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~256] tid 10 osd.1 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 10 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _send_op 10 to 15.1 on osd.1 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:10 15.1 15:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f336c30 con 0x56410f3347b0 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 11 ==== osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 9 ondisk uv 1 in 15.1 attempt 0 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 9 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 9 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 9 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 12 ==== osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 10 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 10 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 10 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 10 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.968 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f335ee0 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~256] tid 11 osd.1 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 11 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _send_op 11 to 15.1 on osd.1 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:11 15.1 15:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f336780 con 0x56410f3347b0 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~256) 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f336c60 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~256] tid 12 osd.1 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 12 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _send_op 12 to 15.1 on osd.1 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:12 15.1 15:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337110 con 0x56410f3347b0 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 13 ==== osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 11 ondisk uv 1 in 15.1 attempt 0 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 11 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 11 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 11 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 14 ==== osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.969 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 12 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 12 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 12 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 12 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (0 ms) 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f3356b0 write_seq 1 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=write 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f335ee0 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [write 0~5 in=5b] tid 13 osd.1 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 13 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _send_op 13 to 15.1 on osd.1 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:13 15.1 15:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f336780 con 0x56410f3347b0 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 15 ==== osd_op_reply(13 exist [write 0~5] v32'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(13 exist [write 0~5] v32'2 uv2 ondisk = 0) 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 13 ondisk uv 2 in 15.1 attempt 0 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 13 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 13 2026-02-24T17:25:36.970 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 13 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f3356b0 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (1 ms) 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f3357c0 write_seq 2 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=write 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f335ee0 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [write 0~5 in=5b] tid 14 osd.1 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 14 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _send_op 14 to 15.1 on osd.1 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:14 15.1 15:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f336780 con 0x56410f3347b0 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 16 ==== osd_op_reply(14 exist [write 0~5] v32'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(14 exist [write 0~5] v32'3 uv3 ondisk = 0) 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 14 ondisk uv 3 in 15.1 attempt 0 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 14 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 14 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 14 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (0 ms) 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f3357c0 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f338c80 write_seq 3 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=write 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f335ee0 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.971 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [write 0~5 in=5b] tid 15 osd.1 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 15 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 15 client.4681.objecter _send_op 15 to 15.1 on osd.1 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:15 15.1 15:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f336780 con 0x56410f3347b0 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.960+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 17 ==== osd_op_reply(15 exist [write 0~5] v32'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(15 exist [write 0~5] v32'4 uv4 ondisk = 0) 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 15 ondisk uv 4 in 15.1 attempt 0 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 15 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 15 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 15 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f338c80 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1 ms) 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f337ca0 write_seq 4 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=write 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33db70 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [write 0~5 in=5b] tid 16 osd.1 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 16 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 16 to 15.1 on osd.1 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:16 15.1 15:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f33e020 con 0x56410f3347b0 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 18 ==== osd_op_reply(16 exist [write 0~5] v32'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(16 exist [write 0~5] v32'5 uv5 ondisk = 0) 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 16 ondisk uv 5 in 15.1 attempt 0 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 16 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 16 2026-02-24T17:25:36.972 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 16 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f337ca0 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (0 ms) 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f33e3e0 write_seq 5 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=write 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de90 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [write 0~5 in=5b] tid 17 osd.1 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 17 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 17 to 15.1 on osd.1 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:17 15.1 15:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f33e5b0 con 0x56410f3347b0 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 19 ==== osd_op_reply(17 exist [write 0~5] v32'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(17 exist [write 0~5] v32'6 uv6 ondisk = 0) 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 17 ondisk uv 6 in 15.1 attempt 0 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 17 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 17 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 17 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f33e3e0 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (0 ms) 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de90 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~0] tid 18 osd.1 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 18 2026-02-24T17:25:36.973 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 18 to 15.1 on osd.1 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:18 15.1 15:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f33e5b0 con 0x56410f3347b0 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f336c60 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~0] tid 19 osd.1 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 19 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 19 to 15.1 on osd.1 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:19 15.1 15:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337110 con 0x56410f3347b0 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 20 ==== osd_op_reply(18 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(18 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T17:25:36.974 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 18 ondisk uv 6 in 15.1 attempt 0 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 18 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 18 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 18 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 21 ==== osd_op_reply(19 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(19 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 19 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 19 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 19 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 19 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~0] tid 20 osd.1 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 20 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 20 to 15.1 on osd.1 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:20 15.1 15:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f33e5b0 con 0x56410f3347b0 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f336c60 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~0] tid 21 osd.1 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.975 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 21 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 21 to 15.1 on osd.1 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:21 15.1 15:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337110 con 0x56410f3347b0 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 22 ==== osd_op_reply(20 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(20 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 20 ondisk uv 6 in 15.1 attempt 0 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 20 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 20 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 20 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 23 ==== osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 21 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 21 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 21 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (0 ms) 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 21 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~0] tid 22 osd.1 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 22 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 22 to 15.1 on osd.1 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:22 15.1 15:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337500 con 0x56410f3347b0 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.976 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f336c60 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~0] tid 23 osd.1 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 23 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 23 to 15.1 on osd.1 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:23 15.1 15:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337110 con 0x56410f3347b0 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 24 ==== osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 22 ondisk uv 6 in 15.1 attempt 0 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 22 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 22 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 22 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 25 ==== osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 23 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 23 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 23 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 23 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~0] tid 24 osd.1 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.977 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 24 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 24 to 15.1 on osd.1 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:24 15.1 15:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337500 con 0x56410f3347b0 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f336d90 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~0] tid 25 osd.1 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 25 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 15 client.4681.objecter _send_op 25 to 15.1 on osd.1 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:25 15.1 15:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f33e5b0 con 0x56410f3347b0 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 26 ==== osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 24 ondisk uv 6 in 15.1 attempt 0 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 24 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 24 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 24 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 27 ==== osd_op_reply(25 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(25 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 25 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 25 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 25 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 25 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.978 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.964+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [read 0~0] tid 26 osd.1 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 26 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _send_op 26 to 15.1 on osd.1 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:26 15.1 15:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337500 con 0x56410f3347b0 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=read(0~0) 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f336d90 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [read 0~0] tid 27 osd.1 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 27 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _send_op 27 to 15.1 on osd.1 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:27 15.1 15:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f33e5b0 con 0x56410f3347b0 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 28 ==== osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 26 ondisk uv 6 in 15.1 attempt 0 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 5 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 26 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 26 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 26 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 29 ==== osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 27 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 27 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 27 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.979 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 27 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (0 ms) 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f3379b0 write_seq 6 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=writefull 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [writefull 0~5 in=5b] tid 28 osd.1 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 28 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _send_op 28 to 15.1 on osd.1 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:28 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f337500 con 0x56410f3347b0 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 30 ==== osd_op_reply(28 exist [writefull 0~5] v32'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(28 exist [writefull 0~5] v32'7 uv7 ondisk = 0) 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 28 ondisk uv 7 in 15.1 attempt 0 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 28 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 28 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 28 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (0 ms) 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f3379b0 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f337ac0 write_seq 7 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=writefull 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [writefull 0~5 in=5b] tid 29 osd.1 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 29 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _send_op 29 to 15.1 on osd.1 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:29 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f336c60 con 0x56410f3347b0 2026-02-24T17:25:36.980 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 31 ==== osd_op_reply(29 exist [writefull 0~5] v32'8 uv8 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(29 exist [writefull 0~5] v32'8 uv8 ondisk = 0) 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 29 ondisk uv 8 in 15.1 attempt 0 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 29 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 29 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 29 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (0 ms) 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f337ac0 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f3379b0 write_seq 8 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=writefull 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [writefull 0~5 in=5b] tid 30 osd.1 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 30 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _send_op 30 to 15.1 on osd.1 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:30 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f336c60 con 0x56410f3347b0 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 32 ==== osd_op_reply(30 exist [writefull 0~5] v32'9 uv9 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(30 exist [writefull 0~5] v32'9 uv9 ondisk = 0) 2026-02-24T17:25:36.981 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 30 ondisk uv 9 in 15.1 attempt 0 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 30 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 30 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 30 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f3379b0 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (0 ms) 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f337ac0 write_seq 9 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=writefull 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.982 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [writefull 0~5 in=5b] tid 31 osd.1 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 31 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _send_op 31 to 15.1 on osd.1 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:31 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f336c60 con 0x56410f3347b0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 33 ==== osd_op_reply(31 exist [writefull 0~5] v32'10 uv10 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(31 exist [writefull 0~5] v32'10 uv10 ondisk = 0) 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 31 ondisk uv 10 in 15.1 attempt 0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 31 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 31 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 31 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (0 ms) 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f337ac0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f3379b0 write_seq 10 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=writefull 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [writefull 0~5 in=5b] tid 32 osd.1 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 32 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 15 client.4681.objecter _send_op 32 to 15.1 on osd.1 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:32 15.1 15:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f336c60 con 0x56410f3347b0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.968+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 34 ==== osd_op_reply(32 exist [writefull 0~5] v32'11 uv11 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(32 exist [writefull 0~5] v32'11 uv11 ondisk = 0) 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 32 ondisk uv 11 in 15.1 attempt 0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 32 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 32 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 32 2026-02-24T17:25:36.983 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f3379b0 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (1 ms) 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f33de50 linger_id 1 cookie 94837427920464 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 1 register 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f337080 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [notify cookie 94837427920464 in=17b] tid 33 osd.1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 33 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 33 to 15.1 on osd.1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:33 15.1 15:8049a5cb:::exist:head [notify cookie 94837427920464 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337530 con 0x56410f3347b0 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f3405d0 linger_id 2 cookie 94837427930576 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 2 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 2 register 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f341a10 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [notify cookie 94837427930576 in=17b] tid 34 osd.1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 34 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 34 to 15.1 on osd.1 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:34 15.1 15:855dde50:::noexist:head [notify cookie 94837427930576 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337530 con 0x56410f3347b0 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 35 ==== watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953472 ret 0) ==== 42+0+8 (crc 0 0 0) 0x7f9c940c4040 con 0x56410f3347b0 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953472 ret 0) 2026-02-24T17:25:36.984 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 36 ==== osd_op_reply(33 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(33 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 33 ondisk uv 11 in 15.1 attempt 0 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 8 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: operator() completed notify (linger op 0x56410f33de50), ec = system:0 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 33 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 33 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 33 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 client.4681.objecter _linger_commit 1 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 client.4681.objecter _linger_commit notify_id=137438953472 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 librados: finish linger op 0x56410f33de50 acked (0) 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter _linger_cancel linger_id=1 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 15 client.4681.objecter _session_linger_op_remove 1 1 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 37 ==== osd_op_reply(34 noexist [notify cookie 94837427930576] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(34 noexist [notify cookie 94837427930576] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 34 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 34 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 34 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 34 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 client.4681.objecter _linger_commit 2 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: finish linger op 0x56410f3405d0 acked (-2) 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 librados: operator() completed notify (linger op 0x56410f3405d0), ec = osd:2 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter _linger_cancel linger_id=2 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 15 client.4681.objecter _session_linger_op_remove 1 2 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (0 ms) 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f33de50 linger_id 3 cookie 94837427920464 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 3 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 3 register 2026-02-24T17:25:36.985 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f337080 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [notify cookie 94837427920464 in=17b] tid 35 osd.1 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 35 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 35 to 15.1 on osd.1 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:35 15.1 15:8049a5cb:::exist:head [notify cookie 94837427920464 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337530 con 0x56410f3347b0 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f2da7e0 linger_id 4 cookie 94837427513312 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 4 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 4 register 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33e5b0 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [notify cookie 94837427513312 in=17b] tid 36 osd.1 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 36 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 36 to 15.1 on osd.1 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:36 15.1 15:855dde50:::noexist:head [notify cookie 94837427513312 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f33eb70 con 0x56410f3347b0 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 38 ==== watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953473 ret 0) ==== 42+0+8 (crc 0 0 0) 0x7f9c940c4040 con 0x56410f3347b0 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953473 ret 0) 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: operator() completed notify (linger op 0x56410f33de50), ec = system:0 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 39 ==== osd_op_reply(35 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(35 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 35 ondisk uv 11 in 15.1 attempt 0 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 8 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 35 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 35 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 35 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 client.4681.objecter _linger_commit 3 2026-02-24T17:25:36.986 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 client.4681.objecter _linger_commit notify_id=137438953473 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 librados: finish linger op 0x56410f33de50 acked (0) 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter _linger_cancel linger_id=3 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 15 client.4681.objecter _session_linger_op_remove 1 3 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 40 ==== osd_op_reply(36 noexist [notify cookie 94837427513312] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(36 noexist [notify cookie 94837427513312] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 36 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 36 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 36 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 36 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 client.4681.objecter _linger_commit 4 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: finish linger op 0x56410f2da7e0 acked (-2) 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: operator() completed notify (linger op 0x56410f2da7e0), ec = osd:2 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter _linger_cancel linger_id=4 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 15 client.4681.objecter _session_linger_op_remove 1 4 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (0 ms) 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f33de50 linger_id 5 cookie 94837427920464 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 5 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 5 register 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33e5b0 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [notify cookie 94837427920464 in=17b] tid 37 osd.1 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 37 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 37 to 15.1 on osd.1 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:37 15.1 15:8049a5cb:::exist:head [notify cookie 94837427920464 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337080 con 0x56410f3347b0 2026-02-24T17:25:36.987 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f340b10 linger_id 6 cookie 94837427931920 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 6 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 6 register 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f341f50 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [notify cookie 94837427931920 in=17b] tid 38 osd.1 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 38 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 38 to 15.1 on osd.1 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:38 15.1 15:855dde50:::noexist:head [notify cookie 94837427931920 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f342440 con 0x56410f3347b0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 41 ==== watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953474 ret 0) ==== 42+0+8 (crc 0 0 0) 0x7f9c940c4040 con 0x56410f3347b0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953474 ret 0) 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 librados: operator() completed notify (linger op 0x56410f33de50), ec = system:0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 42 ==== osd_op_reply(37 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(37 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 37 ondisk uv 11 in 15.1 attempt 0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 8 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 37 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 37 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 37 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 client.4681.objecter _linger_commit 5 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 43 ==== osd_op_reply(38 noexist [notify cookie 94837427931920] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 client.4681.objecter _linger_commit notify_id=137438953474 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(38 noexist [notify cookie 94837427931920] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 38 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: finish linger op 0x56410f33de50 acked (0) 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.988 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 38 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 38 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter _linger_cancel linger_id=5 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 38 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 15 client.4681.objecter _session_linger_op_remove 1 5 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 client.4681.objecter _linger_commit 6 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 librados: finish linger op 0x56410f340b10 acked (-2) 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 librados: operator() completed notify (linger op 0x56410f340b10), ec = osd:2 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter _linger_cancel linger_id=6 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (0 ms) 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 15 client.4681.objecter _session_linger_op_remove 1 6 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f33de50 linger_id 7 cookie 94837427920464 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 7 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 7 register 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33e5b0 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [notify cookie 94837427920464 in=17b] tid 39 osd.1 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 39 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 39 to 15.1 on osd.1 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:39 15.1 15:8049a5cb:::exist:head [notify cookie 94837427920464 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337080 con 0x56410f3347b0 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f340aa0 linger_id 8 cookie 94837427931808 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 8 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 8 register 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f341ee0 2026-02-24T17:25:36.989 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [notify cookie 94837427931808 in=17b] tid 40 osd.1 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 40 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 40 to 15.1 on osd.1 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:40 15.1 15:855dde50:::noexist:head [notify cookie 94837427931808 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f3423f0 con 0x56410f3347b0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 44 ==== watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953475 ret 0) ==== 42+0+8 (crc 0 0 0) 0x7f9c940c4040 con 0x56410f3347b0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953475 ret 0) 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: operator() completed notify (linger op 0x56410f33de50), ec = system:0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 45 ==== osd_op_reply(39 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(39 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 39 ondisk uv 11 in 15.1 attempt 0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 8 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 39 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 39 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 39 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 client.4681.objecter _linger_commit 7 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 client.4681.objecter _linger_commit notify_id=137438953475 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 librados: finish linger op 0x56410f33de50 acked (0) 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter _linger_cancel linger_id=7 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 15 client.4681.objecter _session_linger_op_remove 1 7 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 46 ==== osd_op_reply(40 noexist [notify cookie 94837427931808] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(40 noexist [notify cookie 94837427931808] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 40 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 40 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 40 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 40 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 client.4681.objecter _linger_commit 8 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: finish linger op 0x56410f340aa0 acked (-2) 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: operator() completed notify (linger op 0x56410f340aa0), ec = osd:2 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter _linger_cancel linger_id=8 2026-02-24T17:25:36.990 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 15 client.4681.objecter _session_linger_op_remove 1 8 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (0 ms) 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f33de50 linger_id 9 cookie 94837427920464 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.d3a59201 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 9 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 9 register 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f2d97d0 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base exist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target exist @15 -> pgid 15.d3a59201 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid exist '@15' '@15' [notify cookie 94837427920464 in=17b] tid 41 osd.1 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 41 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 41 to 15.1 on osd.1 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:41 15.1 15:8049a5cb:::exist:head [notify cookie 94837427920464 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337080 con 0x56410f3347b0 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter linger_register info 0x56410f2d9d90 linger_id 10 cookie 94837427510672 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 5 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_linger_op_assign 1 10 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter send_linger 10 register 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f2db1d0 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [notify cookie 94837427510672 in=17b] tid 42 osd.1 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 42 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 42 to 15.1 on osd.1 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:42 15.1 15:855dde50:::noexist:head [notify cookie 94837427510672 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f2db750 con 0x56410f3347b0 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 2 in flight 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 47 ==== watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953476 ret 0) ==== 42+0+8 (crc 0 0 0) 0x7f9c940c4040 con 0x56410f3347b0 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 watch-notify(notify_complete (2) cookie 94837427920464 notify 137438953476 ret 0) 2026-02-24T17:25:36.991 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca09e5640 10 librados: operator() completed notify (linger op 0x56410f33de50), ec = system:0 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 48 ==== osd_op_reply(41 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(41 exist [notify cookie 94837427920464 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 41 ondisk uv 11 in 15.1 attempt 0 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 8 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 41 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 41 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 7 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 41 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 client.4681.objecter _linger_commit 9 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 49 ==== osd_op_reply(42 noexist [notify cookie 94837427510672] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 client.4681.objecter _linger_commit notify_id=137438953476 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(42 noexist [notify cookie 94837427510672] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: finish linger op 0x56410f33de50 acked (0) 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 42 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter _linger_cancel linger_id=9 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 42 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 42 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 6 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 42 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 15 client.4681.objecter _session_linger_op_remove 1 9 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 client.4681.objecter _linger_commit 10 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: finish linger op 0x56410f2d9d90 acked (-2) 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (0 ms) 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 10 librados: operator() completed notify (linger op 0x56410f2d9d90), ec = osd:2 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter _linger_cancel linger_id=10 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9c93fff640 15 client.4681.objecter _session_linger_op_remove 1 10 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=stat 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [stat] tid 43 osd.1 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.992 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 43 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 43 to 15.1 on osd.1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:43 15.1 15:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337080 con 0x56410f3347b0 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter _op_cancel: cancelling tid 43 r=-125 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter op_cancel tid 43 in session 1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _finish_op 43 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_remove 1 43 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=stat 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [stat] tid 44 osd.1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 44 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 44 to 15.1 on osd.1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:44 15.1 15:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56410f337080 con 0x56410f3347b0 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter _op_cancel: cancelling tid 44 r=-125 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter op_cancel tid 44 in session 1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _finish_op 44 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_remove 1 44 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f2dbb40 write_seq 11 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=stat 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [stat] tid 45 osd.1 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 45 2026-02-24T17:25:36.993 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 45 to 15.1 on osd.1 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:45 15.1 15:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f337080 con 0x56410f3347b0 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter _op_cancel: cancelling tid 45 r=-125 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter op_cancel tid 45 in session 1 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 librados: complete_aio_write 0x56410f2dbb40 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _finish_op 45 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_remove 1 45 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 librados: queue_aio_write 0x56410f1567c0 completion 0x56410f2dbb40 write_seq 12 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 SplitOp::orig_op: osd=-1 shard=255 balance_reads=0 ops.size()=1 needs_version=true op_code=stat 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 SplitOp::create REJECT: split reads off 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit op 0x56410f33de50 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target epoch 32 base noexist @15 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _calc_target target noexist @15 -> pgid 15.a7bbaa1 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _calc_target raw pgid 15.a7bbaa1 -> actual 15.1 acting [1,3] primary 1 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter _get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter _op_submit oid noexist '@15' '@15' [stat] tid 46 osd.1 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter get_session s=0x56410f156610 osd=1 3 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _session_op_assign 1 46 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 15 client.4681.objecter _send_op 46 to 15.1 on osd.1 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 --> v2:10.20.193.94:6808/2000550170 -- osd_op(unknown.0.0:46 15.1 15:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56410f337080 con 0x56410f3347b0 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 5 client.4681.objecter 1 in flight 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 50 ==== osd_op_reply(43 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(43 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 43 ondisk ... stray 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 51 ==== osd_op_reply(44 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(44 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 44 ondisk ... stray 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 52 ==== osd_op_reply(45 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(45 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 45 ondisk ... stray 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 <== osd.1 v2:10.20.193.94:6808/2000550170 53 ==== osd_op_reply(46 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9c940bc070 con 0x56410f3347b0 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter ms_dispatch2 0x56410f19f990 osd_op_reply(46 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter in handle_osd_op_reply 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 7 client.4681.objecter handle_osd_op_reply 46 ondisk uv 0 in 15.1 attempt 0 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 10 client.4681.objecter op 0 rval 0 len 0 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter handle_osd_op_reply completed tid 46 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _finish_op 46 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 client.4681.objecter put_session s=0x56410f156610 osd=1 4 2026-02-24T17:25:36.994 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 15 client.4681.objecter _session_op_remove 1 46 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 5 client.4681.objecter 0 in flight 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 20 librados: complete_aio_write 0x56410f2dbb40 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (0 ms) 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 librados: watch_flush enter 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 librados: watch_flush exit 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter close_session for osd.1 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 >> v2:10.20.193.94:6808/2000550170 conn(0x56410f3347b0 msgr2=0x56410f334bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 --2- 10.20.193.120:0/4258064095 >> v2:10.20.193.94:6808/2000550170 conn(0x56410f3347b0 0x56410f334bb0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter put_session s=0x56410f156610 osd=1 1 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 20 client.4681.objecter shutdown clearing up homeless session... 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 10 client.4681.objecter successfully canceled tick 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 >> v2:10.20.193.120:6800/397309233 conn(0x7f9c80072ac0 msgr2=0x7f9c80092f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 --2- 10.20.193.120:0/4258064095 >> v2:10.20.193.120:6800/397309233 conn(0x7f9c80072ac0 0x7f9c80092f70 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c98002fa0 tx=0x7f9c9800d040 comp rx=0 tx=0).stop 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f22e020 msgr2=0x56410f31bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 --2- 10.20.193.120:0/4258064095 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x56410f22e020 0x56410f31bce0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c8c001480 tx=0x7f9c8c00b6d0 comp rx=0 tx=0).stop 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca29e9640 1 -- 10.20.193.120:0/4258064095 reap_dead start 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 shutdown_connections 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 >> 10.20.193.120:0/4258064095 conn(0x56410f2b56f0 msgr2=0x56410f2d5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 shutdown_connections 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.972+0000 7f9ca4710980 1 -- 10.20.193.120:0/4258064095 wait complete. 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.976+0000 7f9ca4710980 1 librados: shutdown 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [----------] 29 tests from AsioRados (16 ms total) 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [----------] Global test environment tear-down 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (1428 ms total) 2026-02-24T17:25:36.995 INFO:tasks.workunit.client.0.trial120.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-24T17:25:37.215 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-24T17:25:37.216 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [----------] Global test environment set-up. 2026-02-24T17:25:37.216 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-24T17:25:37.216 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-24T17:25:37.216 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosList.ListObjects (123 ms) 2026-02-24T17:25:37.216 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-24T17:25:37.217 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (17 ms) 2026-02-24T17:25:37.217 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-24T17:25:37.217 INFO:tasks.workunit.client.0.trial120.stdout: api_list: myset foo1,foo2,foo3 2026-02-24T17:25:37.217 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo1 2026-02-24T17:25:37.217 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo2 2026-02-24T17:25:37.218 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo3 2026-02-24T17:25:37.218 INFO:tasks.workunit.client.0.trial120.stdout: api_list: myset foo1,foo4,foo5 2026-02-24T17:25:37.218 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo4 2026-02-24T17:25:37.218 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo5 2026-02-24T17:25:37.218 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo1 2026-02-24T17:25:37.218 INFO:tasks.workunit.client.0.trial120.stdout: api_list: myset foo6,foo7 2026-02-24T17:25:37.219 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo7 2026-02-24T17:25:37.219 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo6 2026-02-24T17:25:37.219 INFO:tasks.workunit.client.0.trial120.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T17:25:37.219 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns1:foo4 2026-02-24T17:25:37.219 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns1:foo5 2026-02-24T17:25:37.219 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns2:foo7 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns2:foo6 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns1:foo1 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: :foo1 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: :foo2 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: :foo3 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (52 ms) 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 1 0 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 10 0 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 13 0 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 7 0 2026-02-24T17:25:37.220 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 14 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 0 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 15 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 11 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 5 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 8 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 6 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 3 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 4 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 12 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 9 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 2 0 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T17:25:37.221 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (51 ms) 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: x cursor=MIN 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=1 cursor=7:02547ec2:::1:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=10 cursor=7:52ea6a34:::10:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=13 cursor=7:566253c9:::13:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=7 cursor=7:5c6b0b28:::7:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=14 cursor=7:62a1935d:::14:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=0 cursor=7:6cac518f:::0:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=15 cursor=7:863748b0:::15:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=11 cursor=7:89d3ae78:::11:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=5 cursor=7:b29083e3:::5:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=8 cursor=7:bd63b0f1:::8:head 2026-02-24T17:25:37.222 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=6 cursor=7:c4fdafeb:::6:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=3 cursor=7:cfc208b3:::3:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=4 cursor=7:d83876eb:::4:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=12 cursor=7:de5d7c5f:::12:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=9 cursor=7:e960b815:::9:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > oid=2 cursor=7:f905c69b:::2:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=1 cursor=7:02547ec2:::1:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:02547ec2:::1:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:02547ec2:::1:head -> 1 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=10 cursor=7:52ea6a34:::10:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:52ea6a34:::10:head 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:52ea6a34:::10:head -> 10 2026-02-24T17:25:37.223 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=13 cursor=7:566253c9:::13:head 2026-02-24T17:25:37.224 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:566253c9:::13:head 2026-02-24T17:25:37.224 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:566253c9:::13:head -> 13 2026-02-24T17:25:37.224 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=7 cursor=7:5c6b0b28:::7:head 2026-02-24T17:25:37.224 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:5c6b0b28:::7:head 2026-02-24T17:25:37.224 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:5c6b0b28:::7:head -> 7 2026-02-24T17:25:37.224 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=14 cursor=7:62a1935d:::14:head 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:62a1935d:::14:head 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:62a1935d:::14:head -> 14 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=0 cursor=7:6cac518f:::0:head 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:6cac518f:::0:head 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:6cac518f:::0:head -> 0 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=15 cursor=7:863748b0:::15:head 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:863748b0:::15:head 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:863748b0:::15:head -> 15 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=11 cursor=7:89d3ae78:::11:head 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:89d3ae78:::11:head 2026-02-24T17:25:37.262 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:89d3ae78:::11:head -> 11 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=5 cursor=7:b29083e3:::5:head 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:b29083e3:::5:head 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:b29083e3:::5:head -> 5 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=8 cursor=7:bd63b0f1:::8:head 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:bd63b0f1:::8:head 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:bd63b0f1:::8:head -> 8 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=6 cursor=7:c4fdafeb:::6:head 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:c4fdafeb:::6:head 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:c4fdafeb:::6:head -> 6 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=3 cursor=7:cfc208b3:::3:head 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:cfc208b3:::3:head 2026-02-24T17:25:37.263 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:cfc208b3:::3:head -> 3 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=4 cursor=7:d83876eb:::4:head 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:d83876eb:::4:head 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:d83876eb:::4:head -> 4 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=12 cursor=7:de5d7c5f:::12:head 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:de5d7c5f:::12:head 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:de5d7c5f:::12:head -> 12 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=9 cursor=7:e960b815:::9:head 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:e960b815:::9:head 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:e960b815:::9:head -> 9 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : oid=2 cursor=7:f905c69b:::2:head 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:f905c69b:::2:head 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:f905c69b:::2:head -> 2 2026-02-24T17:25:37.264 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:02547ec2:::1:head 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:02547ec2:::1:head expected=7:02547ec2:::1:head 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:02547ec2:::1:head -> 1 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=1 expected=1 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:f905c69b:::2:head 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:f905c69b:::2:head expected=7:f905c69b:::2:head 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:f905c69b:::2:head -> 2 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=2 expected=2 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:e960b815:::9:head 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:e960b815:::9:head expected=7:e960b815:::9:head 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:e960b815:::9:head -> 9 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=9 expected=9 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:52ea6a34:::10:head 2026-02-24T17:25:37.265 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:52ea6a34:::10:head expected=7:52ea6a34:::10:head 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:52ea6a34:::10:head -> 10 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=10 expected=10 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:de5d7c5f:::12:head 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:de5d7c5f:::12:head expected=7:de5d7c5f:::12:head 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:de5d7c5f:::12:head -> 12 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=12 expected=12 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:d83876eb:::4:head 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:d83876eb:::4:head expected=7:d83876eb:::4:head 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:d83876eb:::4:head -> 4 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=4 expected=4 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:cfc208b3:::3:head 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:cfc208b3:::3:head expected=7:cfc208b3:::3:head 2026-02-24T17:25:37.266 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:cfc208b3:::3:head -> 3 2026-02-24T17:25:37.267 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=3 expected=3 2026-02-24T17:25:37.267 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:c4fdafeb:::6:head 2026-02-24T17:25:37.267 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:c4fdafeb:::6:head expected=7:c4fdafeb:::6:head 2026-02-24T17:25:37.267 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:c4fdafeb:::6:head -> 6 2026-02-24T17:25:37.267 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=6 expected=6 2026-02-24T17:25:37.267 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:bd63b0f1:::8:head 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : list_parallel: process_1_[20776]: starting. 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_1_[20776]: creating pool ceph_test_rados_list_parallel.trial120-20696 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_1_[20776]: created object 0... 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_1_[20776]: created object 25... 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_1_[20776]: created object 49... 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_1_[20776]: finishing. 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_1_[20776]: shutting down. 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_2_[20777]: starting. 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_2_[20777]: listing objects. 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_2_[20777]: listed object 0... 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_2_[20777]: listed object 25... 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_2_[20777]: saw 50 objects 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_2_[20777]: shutting down. 2026-02-24T17:25:37.774 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_3_[21374]: starting. 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_3_[21374]: creating pool ceph_test_rados_list_parallel.trial120-20696 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_3_[21374]: created object 0... 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_3_[21374]: created object 25... 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_3_[21374]: created object 49... 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_3_[21374]: finishing. 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_3_[21374]: shutting down. 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_4_[21375]: starting. 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_4_[21375]: listing objects. 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_4_[21375]: listed object 0... 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_4_[21375]: listed object 25... 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_4_[21375]: saw 41 objects 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_4_[21375]: shutting down. 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_5_[21376]: starting. 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_5_[21376]: removed 25 objects... 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_5_[21376]: removed half of the objects 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_5_[21376]: removed 50 objects... 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_5_[21376]: removed 50 objects 2026-02-24T17:25:37.775 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_5_[21376]: shutting down. 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_6_[21425]: starting. 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_6_[21425]: creating pool ceph_test_rados_list_parallel.trial120-20696 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_6_[21425]: created object 0... 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_6_[21425]: created object 25... 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_6_[21425]: created object 49... 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_6_[21425]: finishing. 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_6_[21425]: shutting down. 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_8_[21427]: starting. 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_8_[21427]: added 25 objects... 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_8_[21427]: added half of the objects 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_8_[21427]: added 50 objects... 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_8_[21427]: added 50 objects 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_8_[21427]: shutting down. 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.776 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_7_[21426]: starting. 2026-02-24T17:25:37.777 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_7_[21426]: listing objects. 2026-02-24T17:25:37.777 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_7_[21426]: listed object 0... 2026-02-24T17:25:37.777 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_7_[21426]: listed object 25... 2026-02-24T17:25:37.777 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_7_[21426]: listed object 50... 2026-02-24T17:25:37.777 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_7_[21426]: saw 73 objects 2026-02-24T17:25:37.777 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_7_[21426]: shutting down. 2026-02-24T17:25:37.777 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.777 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:37.913 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:25:37.905+0000 7fe8108d8640 -1 osd.4 32 handle_osd_map injecting map crc failure 2026-02-24T17:25:37.914 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:25:37.910+0000 7fed2bebc640 -1 osd.9 32 handle_osd_map injecting map crc failure 2026-02-24T17:25:37.919 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:25:37.908+0000 7f9b65176640 -1 osd.15 32 handle_osd_map injecting map crc failure 2026-02-24T17:25:37.919 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:25:37.912+0000 7f9b65176640 -1 osd.15 32 handle_osd_map injecting map crc failure 2026-02-24T17:25:37.920 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ************************* api_c_read_operations: Running main() from gmock_main.cc 2026-02-24T17:25:37.920 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-24T17:25:37.920 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-24T17:25:37.920 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-24T17:25:37.920 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-24T17:25:37.920 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-24T17:25:37.921 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-24T17:25:37.921 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (64 ms) 2026-02-24T17:25:37.921 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-24T17:25:37.921 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (4 ms) 2026-02-24T17:25:37.921 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-24T17:25:37.921 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (3 ms) 2026-02-24T17:25:37.921 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-24T17:25:37.921 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (12 ms) 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (2 ms) 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (2 ms) 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (6 ms) 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (2 ms) 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-24T17:25:37.922 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (1 ms) 2026-02-24T17:25:37.923 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-24T17:25:37.923 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (4 ms) 2026-02-24T17:25:37.923 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-24T17:25:37.923 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (3 ms) 2026-02-24T17:25:37.923 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-24T17:25:37.923 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (3 ms) 2026-02-24T17:25:37.923 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (6 ms) 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (6 ms) 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (4 ms) 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (1 ms) 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (133 ms total) 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: 2026-02-24T17:25:37.924 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (2343 ms total) 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: Running main() from gmock_main.cc 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [----------] Global test environment set-up. 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (2327 ms) 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [----------] 1 test from neocls_handler_error (2327 ms total) 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [----------] Global test environment tear-down 2026-02-24T17:25:37.925 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [==========] 1 test from 1 test suite ran. (2327 ms total) 2026-02-24T17:25:37.926 INFO:tasks.workunit.client.0.trial120.stdout: handler_error: [ PASSED ] 1 test. 2026-02-24T17:25:37.926 INFO:tasks.workunit.client.0.trial120.stdout: cls: Running main() from gmock_main.cc 2026-02-24T17:25:37.926 INFO:tasks.workunit.client.0.trial120.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: [----------] Global test environment set-up. 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: [ OK ] NeoRadosCls.DNE (2332 ms) 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: [----------] 1 test from NeoRadosCls (2332 ms total) 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: [----------] Global test environment tear-down 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: [==========] 1 test from 1 test suite ran. (2332 ms total) 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: cls: [ PASSED ] 1 test. 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-24T17:25:37.927 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (16 ms) 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (47 ms) 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (2291 ms) 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (2355 ms total) 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (2355 ms total) 2026-02-24T17:25:37.928 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-24T17:25:37.946 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-24T17:25:37.946 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-24T17:25:37.946 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-24T17:25:37.946 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-24T17:25:37.946 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-24T17:25:37.946 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (22 ms) 2026-02-24T17:25:37.946 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-24T17:25:37.946 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (70 ms) 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (2265 ms) 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.893973+0000 mon.a [INF] from='client.? 10.20.193.120:0/917062616' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritetrial120-20844-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.894036+0000 mon.a [INF] from='client.? 10.20.193.120:0/532522986' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectstrial120-20935-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.894091+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_trial120-20482-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.895989+0000 osd.12 [WRN] failed to encode map e31 with expected crc 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.899001+0000 mon.a [INF] from='client.? 10.20.193.120:0/532522986' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectstrial120-20935-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectstrial120-20935-1"} : dispatch 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.899732+0000 mon.a [INF] from='client.? 10.20.193.120:0/917062616' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "SimpleWritetrial120-20844-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritetrial120-20844-1"} : dispatch 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.903236+0000 mon.a [INF] from='client.4693 10.20.193.120:0/608702827' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_trial120-20399-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.947 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.903959+0000 mon.a [INF] from='client.? 10.20.193.120:0/851155902' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_trial120-20238-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.904298+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_trial120-20246-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.904433+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_trial120-20482-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_trial120-20482-1"} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.905053+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_trial120-20293-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.905208+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20374-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.905366+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_trial120-20278-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.905512+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_trial120-20421-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.905663+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_trial120-20384-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.905717+0000 osd.13 [WRN] failed to encode map e31 with expected crc 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.905809+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_trial120-20440-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.905968+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial120-20337-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.906112+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_trial120-20669-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.948 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.906256+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_trial120-20459-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.906465+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20631-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.906622+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20504-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.906748+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_trial120-20254-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.906921+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_trial120-20270-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.907058+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_trial120-20230-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.907405+0000 mon.c [INF] from='client.? 10.20.193.120:0/3101177692' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_trial120-20482-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_trial120-20482-1"} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.909490+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20549-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.910907+0000 mon.b [INF] from='client.? 10.20.193.120:0/4109344900' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_trial120-20246-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.910971+0000 mon.b [INF] from='client.? 10.20.193.120:0/161191667' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_trial120-20293-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911027+0000 mon.b [INF] from='client.? 10.20.193.120:0/50703236' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_trial120-20278-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.949 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911102+0000 mon.b [INF] from='client.? 10.20.193.120:0/3995771316' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_trial120-20384-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911269+0000 mon.c [INF] from='client.? 10.20.193.120:0/3080975822' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20374-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911349+0000 mon.c [INF] from='client.? 10.20.193.120:0/2350367298' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_trial120-20421-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911416+0000 mon.c [INF] from='client.? 10.20.193.120:0/93148389' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_trial120-20440-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911541+0000 mon.c [INF] from='client.? 10.20.193.120:0/3072214611' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_trial120-20669-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911544+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial120-20337-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911669+0000 mon.b [INF] from='client.? 10.20.193.120:0/3000295058' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_trial120-20459-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911705+0000 mon.c [INF] from='client.? 10.20.193.120:0/1178062330' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20504-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911799+0000 mon.b [INF] from='client.? 10.20.193.120:0/3113563489' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20631-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.911849+0000 mon.c [INF] from='client.? 10.20.193.120:0/2904783649' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_trial120-20254-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.912392+0000 mon.c [INF] from='client.? 10.20.193.120:0/3643265136' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_trial120-20270-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.950 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.912570+0000 mon.c [INF] from='client.? 10.20.193.120:0/4120187295' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_trial120-20230-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:35.916874+0000 mon.b [INF] from='client.? 10.20.193.120:0/108068562' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20549-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.900815+0000 mon.a [INF] from='client.4693 10.20.193.120:0/608702827' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_trial120-20399-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.900859+0000 mon.a [INF] from='client.? 10.20.193.120:0/851155902' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_trial120-20238-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.900893+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_trial120-20246-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.900928+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_trial120-20293-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.900959+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20374-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.900991+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_trial120-20278-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901022+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_trial120-20421-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901052+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_trial120-20384-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.952 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901083+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_trial120-20440-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.953 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901117+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial120-20337-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.953 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901154+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_trial120-20669-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.953 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901181+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_trial120-20459-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.953 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901215+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20631-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:37.953 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901256+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20504-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:38.156 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901284+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_trial120-20254-1","app": "rados","****** 2026-02-24T17:25:38.156 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_9_[21476]: starting. 2026-02-24T17:25:38.156 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_9_[21476]: creating pool ceph_test_rados_list_parallel.trial120-20696 2026-02-24T17:25:38.156 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_9_[21476]: created object 0... 2026-02-24T17:25:38.156 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_9_[21476]: created object 25... 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_9_[21476]: created object 49... 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_9_[21476]: finishing. 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_9_[21476]: shutting down. 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_10_[21477]: starting. 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_10_[21477]: listing objects. 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_10_[21477]: listed object 0... 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_10_[21477]: listed object 25... 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_10_[21477]: listed object 50... 2026-02-24T17:25:38.157 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_10_[21477]: listed object 75... 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_10_[21477]: saw 100 objects 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_10_[21477]: shutting down. 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_13_[21480]: starting. 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_13_[21480]: removed 25 objects... 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_13_[21480]: removed half of the objects 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_13_[21480]: removed 50 objects... 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_13_[21480]: removed 50 objects 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_13_[21480]: shutting down. 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.158 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_11_[21478]: starting. 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_11_[21478]: added 25 objects... 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_11_[21478]: added half of the objects 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_11_[21478]: added 50 objects... 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_11_[21478]: added 50 objects 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_11_[21478]: shutting down. 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_12_[21479]: starting. 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_12_[21479]: added 25 objects... 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_12_[21479]: added half of the objects 2026-02-24T17:25:38.159 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_12_[21479]: added 50 objects... 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_12_[21479]: added 50 objects 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_12_[21479]: shutting down. 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_14_[21855]: starting. 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_14_[21855]: creating pool ceph_test_rados_list_parallel.trial120-20696 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_14_[21855]: created object 0... 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_14_[21855]: created object 25... 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_14_[21855]: created object 49... 2026-02-24T17:25:38.160 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_14_[21855]: finishing. 2026-02-24T17:25:38.161 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_14_[21855]: shutting down. 2026-02-24T17:25:38.161 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.161 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.161 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.161 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.161 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: starting. 2026-02-24T17:25:38.161 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: listing objects. 2026-02-24T17:25:38.161 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: listed object 0... 2026-02-24T17:25:38.918 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:25:38.912+0000 7fd22d90c640 -1 osd.11 33 handle_osd_map injecting map crc failure 2026-02-24T17:25:38.925 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: listed object 25... 2026-02-24T17:25:38.925 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: listed object 50... 2026-02-24T17:25:38.925 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: listed object 75... 2026-02-24T17:25:38.925 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: listed object 100... 2026-02-24T17:25:38.925 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: listed object 125... 2026-02-24T17:25:38.925 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: saw 150 objects 2026-02-24T17:25:38.925 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_15_[21856]: shutting down. 2026-02-24T17:25:38.925 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_16_[21857]: starting. 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_16_[21857]: added 25 objects... 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_16_[21857]: added half of the objects 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_16_[21857]: added 50 objects... 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_16_[21857]: added 50 objects 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: process_16_[21857]: shutting down. 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******************************* 2026-02-24T17:25:38.926 INFO:tasks.workunit.client.0.trial120.stdout: list_parallel: ******* SUCCESS ********** 2026-02-24T17:25:38.954 INFO:tasks.workunit.client.0.trial120.stdout:yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:38.954 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901314+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_trial120-20270-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:38.954 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901343+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_trial120-20230-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:38.954 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.901372+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20549-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:36.916952+0000 osd.5 [WRN] failed to encode map e32 with expected crc 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.320837+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_trial120-20270-1","var":"pg_num","val":"11"} : dispatch 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.328462+0000 mon.c [INF] from='client.? 10.20.193.120:0/3643265136' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_trial120-20270-1","var":"pg_num","val":"11"} : dispatch 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.903949+0000 mon.a [INF] from='client.? 10.20.193.120:0/532522986' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectstrial120-20935-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectstrial120-20935-1"}]': finished 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.904009+0000 mon.a [INF] from='client.? 10.20.193.120:0/917062616' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritetrial120-20844-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritetrial120-20844-1"}]': finished 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.904049+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_trial120-20482-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_trial120-20482-1"}]': finished 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.904102+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_trial120-20270-1","var":"pg_num","val":"11"}]': finished 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.914771+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_trial120-20270-1","var":"pgp_num","val":"11"} : dispatch 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.921743+0000 mon.c [INF] from='client.4676 10.20.193.120:0/3643265136' entity='client.admin' cmd={"prefix":"osd pool set","pool":"LibRadosList_trial120-20270-1","var":"pgp_num","val":"11"} : dispatch 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.909399+0000 osd.4 [WRN] failed to encode map e33 with expected crc 2026-02-24T17:25:38.955 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.915570+0000 osd.15 [WRN] failed to encode map e33 with expected crc 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.916744+0000 osd.15 [WRN] failed to encode map e33 with expected crc 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.917212+0000 osd.9 [WRN] failed to encode map e33 with expected crc 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.940872+0000 mon.b [INF] from='client.? 10.20.193.120:0/3001717934' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial120-20440-7"} : dispatch 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.944110+0000 mon.b [INF] from='client.? 10.20.193.120:0/3742432566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial120-20246-16"} : dispatch 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.946679+0000 mon.b [INF] from='client.? 10.20.193.120:0/1261224966' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_trial120-20254-24"} : dispatch 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.948040+0000 mon.c [INF] from='client.? 10.20.193.120:0/1210529451' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.949556+0000 client.admin [INF] onexx 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.949904+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial120-20440-7"} : dispatch 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.957625+0000 mon.b [INF] from='client.? 10.20.193.120:0/3001717934' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial120-20440-7"} : dispatch 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.959570+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.959700+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial120-20246-16"} : dispatch 2026-02-24T17:25:38.956 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.963335+0000 mon.b [INF] from='client.? 10.20.193.120:0/164934573' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial120-20421-7"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.967241+0000 mon.b [INF] from='client.? 10.20.193.120:0/3742432566' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial120-20246-16"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.985144+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_trial120-20254-24"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.992757+0000 mon.b [INF] from='client.? 10.20.193.120:0/1261224966' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_trial120-20254-24"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:37.996979+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial120-20440-7"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.003661+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial120-20421-7"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.003801+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial120-20246-16"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.003928+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_trial120-20254-24"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.004065+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial120-20440-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.004273+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial120-20421-7"} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.004496+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial120-20246-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.004554+0000 mon.b [INF] from='client.? 10.20.193.120:0/3001717934' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial120-20440-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:38.957 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.004686+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_trial120-20254-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.004843+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial120-20421-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.011161+0000 mon.b [INF] from='client.? 10.20.193.120:0/164934573' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial120-20421-7"} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.011297+0000 mon.b [INF] from='client.? 10.20.193.120:0/3742432566' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial120-20246-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.011427+0000 mon.b [INF] from='client.? 10.20.193.120:0/1261224966' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_trial120-20254-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.011755+0000 mon.b [INF] from='client.? 10.20.193.120:0/164934573' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial120-20421-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.514271+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.0"} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.515057+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.1"} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.515521+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.2"} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.515974+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.3"} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.516408+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.4"} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.517120+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.5"} : dispatch 2026-02-24T17:25:38.958 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.517553+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.6"} : dispatch 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.517979+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.7"} : dispatch 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.518450+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.8"} : dispatch 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.518889+0000 mon.b [INF] from='client.? 10.20.193.120:0/2629859519' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.9"} : dispatch 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.908892+0000 mon.a [INF] from='client.4676 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_trial120-20270-1","var":"pgp_num","val":"11"}]': finished 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.908967+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial120-20440-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.909024+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial120-20246-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.909070+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_trial120-20254-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.909113+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial120-20421-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.914835+0000 mon.a [INF] from='client.? 10.20.193.120:0/917062616' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial120-20844-1"} : dispatch 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.915573+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_trial120-20421-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial120-20421-7"} : dispatch 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.915871+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial120-20440-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial120-20440-7"} : dispatch 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.916122+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_trial120-20246-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial120-20246-16"} : dispatch 2026-02-24T17:25:38.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.916389+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial120-20238-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:38.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.916549+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_trial120-20254-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_trial120-20254-24"} : dispatch 2026-02-24T17:25:38.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.916877+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20374-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:38.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.917861+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20631-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:38.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.918378+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_trial120-20230-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:38.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.921490+0000 mon.b [INF] from='client.? 10.20.193.120:0/164934573' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_trial120-20421-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial120-20421-7"} : dispatch 2026-02-24T17:25:39.918 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:25:39.912+0000 7f9b6717a640 -1 osd.15 34 handle_osd_map injecting map crc failure 2026-02-24T17:25:40.921 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:25:40.916+0000 7fd22d90c640 -1 osd.11 35 handle_osd_map injecting map crc failure 2026-02-24T17:25:40.922 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:25:40.914+0000 7f5986ab2640 -1 osd.0 35 handle_osd_map injecting map crc failure 2026-02-24T17:25:40.925 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:25:40.918+0000 7f5984aae640 -1 osd.0 35 handle_osd_map injecting map crc failure 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_1_[20801]: starting. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_1_[20801]: creating pool ceph_test_rados_delete_pools_parallel.trial120-20756 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_1_[20801]: created object 0... 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_1_[20801]: created object 25... 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_1_[20801]: created object 49... 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_1_[20801]: finishing. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_1_[20801]: shutting down. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_2_[20803]: starting. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_2_[20803]: deleting pool ceph_test_rados_delete_pools_parallel.trial120-20756 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_2_[20803]: shutting down. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: ******************************* 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_3_[21579]: starting. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_3_[21579]: creating pool ceph_test_rados_delete_pools_parallel.trial120-20756 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_3_[21579]: created object 0... 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_3_[21579]: created object 25... 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_3_[21579]: created object 49... 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_3_[21579]: finishing. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_3_[21579]: shutting down. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: ******************************* 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_5_[21583]: starting. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_5_[21583]: listing objects. 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_5_[21583]: listed object 0... 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_5_[21583]: listed object 25... 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_5_[21583]: saw 50 objects 2026-02-24T17:25:40.933 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_5_[21583]: shutting down. 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: ******************************* 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_4_[21582]: starting. 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_4_[21582]: deleting pool ceph_test_rados_delete_pools_parallel.trial120-20756 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: process_4_[21582]: shutting down. 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: ******************************* 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: ******************************* 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_1_[20790]: starting. 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_1_[20790]: creating pool ceph_test_rados_open_pools_parallel.trial120-20729 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_1_[20790]: created object 0... 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_1_[20790]: created object 25... 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_1_[20790]: created object 49... 2026-02-24T17:25:40.934 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_1_[20790]: finishing. 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_1_[20790]: shutting down. 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_2_[20794]: starting. 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_2_[20794]: rados_pool_create. 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_2_[20794]: rados_ioctx_create. 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_2_[20794]: shutting down. 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: ******************************* 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_3_[21573]: starting. 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_3_[21573]: creating pool ceph_test_rados_open_pools_parallel.trial120-20729 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_3_[21573]: created object 0... 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_3_[21573]: created object 25... 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_3_[21573]: created object 49... 2026-02-24T17:25:40.935 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_3_[21573]: finishing. 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_3_[21573]: shutting down. 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: ******************************* 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_4_[21574]: starting. 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_4_[21574]: rados_pool_create. 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_4_[21574]: rados_ioctx_create. 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: process_4_[21574]: shutting down. 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: ******************************* 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: ******************************* 2026-02-24T17:25:40.936 INFO:tasks.workunit.client.0.trial120.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-24T17:25:41.934 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:25:41.930+0000 7fb7cc2d9640 -1 osd.5 36 handle_osd_map injecting map crc failure 2026-02-24T17:25:41.955 INFO:tasks.workunit.client.0.trial120.stdout: cmd: Running main() from gmock_main.cc 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [----------] Global test environment set-up. 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (1341 ms) 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (1993 ms) 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (3032 ms) 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [----------] 3 tests from NeoRadosCmd (6367 ms total) 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [----------] Global test environment tear-down 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [==========] 3 tests from 1 test suite ran. (6367 ms total) 2026-02-24T17:25:41.956 INFO:tasks.workunit.client.0.trial120.stdout: cmd: [ PASSED ] 3 tests. 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.921761+0000 mon.b [INF] from='client.? 10.20.193.120:0/3001717934' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial120-20440-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial120-20440-7"} : dispatch 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.921925+0000 mon.b [INF] from='client.? 10.20.193.120:0/3742432566' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_trial120-20246-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial120-20246-16"} : dispatch 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.922098+0000 mon.b [INF] from='client.? 10.20.193.120:0/4066909671' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial120-20238-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.922387+0000 mon.b [INF] from='client.? 10.20.193.120:0/1261224966' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoECPP_trial120-20254-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_trial120-20254-24"} : dispatch 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.922573+0000 mon.b [INF] from='client.? 10.20.193.120:0/3529863869' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20374-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.923395+0000 mon.b [INF] from='client.? 10.20.193.120:0/1020940637' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20631-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:38.924469+0000 mon.b [INF] from='client.? 10.20.193.120:0/3066662012' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_trial120-20230-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:24:59.600675+0000 osd.7 [WRN] failed to encode map e6 with expected crc 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:13.477583+0000 osd.7 [WRN] failed to encode map e30 with expected crc 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.913419+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial120-20238-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.913471+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20374-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.913508+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20631-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.913553+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_trial120-20230-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.919123+0000 osd.15 [WRN] failed to encode map e35 with expected crc 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.949315+0000 mon.a [INF] from='client.? 10.20.193.120:0/917062616' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritetrial120-20844-1"} : dispatch 2026-02-24T17:25:41.959 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.952573+0000 mon.a [INF] from='client.? 10.20.193.120:0/532522986' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial120-20935-1"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.952917+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.955963+0000 mon.c [INF] from='client.? 10.20.193.120:0/3101177692' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial120-20482-1"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.966852+0000 mon.c [INF] from='client.? 10.20.193.120:0/1466367510' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_trial120-20293-10"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.967157+0000 mon.c [INF] from='client.? 10.20.193.120:0/1848645771' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial120-20278-10"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.970643+0000 mon.c [INF] from='client.? 10.20.193.120:0/1990464327' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial120-20844-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.979120+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial120-20482-1"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.979264+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_trial120-20293-10"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.979423+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial120-20278-10"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.979567+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial120-20844-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.980001+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_trial120-20293-10"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.980167+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial120-20278-10"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.980579+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial120-20293-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.980807+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial120-20278-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.986716+0000 mon.c [INF] from='client.? 10.20.193.120:0/1466367510' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_trial120-20293-10"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.986828+0000 mon.c [INF] from='client.? 10.20.193.120:0/1848645771' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial120-20278-10"} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.987382+0000 mon.c [INF] from='client.? 10.20.193.120:0/1466367510' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial120-20293-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:39.987526+0000 mon.c [INF] from='client.? 10.20.193.120:0/1848645771' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial120-20278-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916594+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_trial120-20421-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial120-20421-7"}]': finished 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916642+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial120-20440-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial120-20440-7"}]': finished 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916683+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_trial120-20246-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial120-20246-16"}]': finished 2026-02-24T17:25:41.960 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916717+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_trial120-20254-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_trial120-20254-24"}]': finished 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916757+0000 mon.a [INF] from='client.? 10.20.193.120:0/532522986' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial120-20935-1"}]': finished 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916784+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial120-20482-1"}]': finished 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916820+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial120-20844-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916853+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial120-20293-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.916888+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial120-20278-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.920364+0000 mon.a [INF] from='client.? 10.20.193.120:0/532522986' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial120-20935-1"} : dispatch 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.920659+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial120-20482-1"} : dispatch 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.921307+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial120-20278-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial120-20278-10"} : dispatch 2026-02-24T17:25:41.961 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.921734+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial120-20293-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial120-20293-10"} : dispatch 2026-02-24T17:25:41.966 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.926554+0000 mon.c [INF] from='client.? 10.20.193.120:0/3101177692' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial120-20482-1" api_io_pp: Running main() from gmock_main.cc 2026-02-24T17:25:41.967 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-24T17:25:41.967 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-24T17:25:41.967 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-24T17:25:41.967 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: seed 20254 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (50 ms) 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (8 ms) 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (1 ms) 2026-02-24T17:25:41.968 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (170 ms) 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (1 ms) 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (1 ms) 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (1 ms) 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (1 ms) 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (3 ms) 2026-02-24T17:25:41.969 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (3 ms) 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (1 ms) 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (2 ms) 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (2 ms) 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (1 ms) 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (2 ms) 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-24T17:25:41.970 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (5 ms) 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (2 ms) 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (2 ms) 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (2 ms) 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (1 ms) 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (2 ms) 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (269 ms total) 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: 2026-02-24T17:25:41.971 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-24T17:25:41.972 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-24T17:25:41.972 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1032 ms) 2026-02-24T17:25:41.972 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-24T17:25:41.972 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (5 ms) 2026-02-24T17:25:41.972 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-24T17:25:41.972 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (2 ms) 2026-02-24T17:25:41.980 INFO:tasks.workunit.client.0.trial120.stdout: api_i} : dispatch 2026-02-24T17:25:41.980 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.926703+0000 mon.c [INF] from='client.? 10.20.193.120:0/1848645771' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial120-20278-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial120-20278-10"} : dispatch 2026-02-24T17:25:41.980 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.926836+0000 mon.c [INF] from='client.? 10.20.193.120:0/1466367510' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial120-20293-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial120-20293-10"} : dispatch 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.926995+0000 mon.c [INF] from='client.? 10.20.193.120:0/1990464327' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial120-20844-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial120-20844-2"} : dispatch 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.927168+0000 mon.b [INF] from='client.? 10.20.193.120:0/4066909671' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial120-20238-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.928405+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial120-20238-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.928709+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial120-20844-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial120-20844-2"} : dispatch 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.945551+0000 mon.a [INF] from='client.? 10.20.193.120:0/3213936630' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial120-20935-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.919864+0000 osd.0 [WRN] failed to encode map e36 with expected crc 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.921666+0000 osd.11 [WRN] failed to encode map e36 with expected crc 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:40.922702+0000 osd.0 [WRN] failed to encode map e36 with expected crc 2026-02-24T17:25:41.981 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.922311+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial120-20238-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T17:25:41.982 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.922406+0000 mon.a [INF] from='client.? 10.20.193.120:0/3213936630' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial120-20935-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T17:25:41.982 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.933443+0000 mon.b [INF] from='client.? 10.20.193.120:0/4066909671' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial120-20238-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-24T17:25:41.982 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.947902+0000 mon.a [INF] from='client.? 10.20.193.120:0/3213936630' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial120-20935-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial120-20935-2"} : dispatch 2026-02-24T17:25:41.982 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.948301+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial120-20238-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-24T17:25:42.937 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:25:42.937+0000 7fb6af2ac640 -1 osd.2 37 handle_osd_map injecting map crc failure 2026-02-24T17:25:43.481 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:25:43.480+0000 7f9cfbed1640 -1 osd.3 38 handle_osd_map injecting map crc failure 2026-02-24T17:25:43.481 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:25:43.480+0000 7f09b3cb4640 -1 osd.7 38 handle_osd_map injecting map crc failure 2026-02-24T17:25:43.487 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:25:43.484+0000 7f9cf9ecd640 -1 osd.3 38 handle_osd_map injecting map crc failure 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.954403+0000 mon.b [INF] from='client.? 10.20.193.120:0/949762493' entity='c api_stat_pp: Running main() from gmock_main.cc 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: seed 20440 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (45 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (53 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (1 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (6 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (107 ms total) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1024 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (0 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (3 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (10 ms) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1038 ms total) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (7932 ms total) 2026-02-24T17:25:43.488 INFO:tasks.workunit.client.0.trial120.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: Running main() from gmock_main.cc 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [----------] Global test environment set-up. 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStat.Stat (82 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (3 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStat.StatNS (14 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (1 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [----------] 5 tests from LibRadosStat (102 ms total) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1033 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (208 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (1 ms) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1244 ms total) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [----------] Global test environment tear-down 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (7936 ms total) 2026-02-24T17:25:43.489 INFO:tasks.workunit.client.0.trial120.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-24T17:25:43.490 INFO:tasks.workunit.client.0.trial120.stdout: api_io: Running main() from gmock_main.cc 2026-02-24T17:25:43.490 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-24T17:25:43.490 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [----------] Global test environment set-up. 2026-02-24T17:25:43.490 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-24T17:25:43.490 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (47 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: no timeout :/ 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: no timeout :/ 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: no timeout :/ 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: no timeout :/ 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: no timeout :/ 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (21 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (3 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.Checksum (1 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (14 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (3 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (4 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (0 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.TruncTest (3 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (2 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.RmXattr (5 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIo.XattrIter (3 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [----------] 14 tests from LibRadosIo (116 ms total) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1026 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (6 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (3 ms) 2026-02-24T17:25:43.491 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (2 ms) 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (5 ms) 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (2 ms) 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (2 ms) 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (6 ms) 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (2 ms) 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1063 ms total) 2026-02-24T17:25:43.492 INFO:tasks.workunit.client.0.trial120.stdout: api_io: 2026-02-24T17:25:43.494 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [----------] Global test environment tear-down 2026-02-24T17:25:43.494 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [==========] 24 tests from 2 test suites ran. (7967 ms total) 2026-02-24T17:25:43.494 INFO:tasks.workunit.client.0.trial120.stdout: api_io: [ PASSED ] 24 tests. 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: Running main() from gmock_main.cc 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [----------] Global test environment set-up. 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [----------] 3 tests from NeoradosList 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [ OK ] NeoradosList.ListObjects (2319 ms) 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [ OK ] NeoradosList.ListObjectsNS (3011 ms) 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [ OK ] NeoradosList.ListObjectsMany (3562 ms) 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [----------] 3 tests from NeoradosList (8892 ms total) 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [----------] Global test environment tear-down 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [==========] 3 tests from 1 test suite ran. (8892 ms total) 2026-02-24T17:25:44.494 INFO:tasks.workunit.client.0.trial120.stdout: list: [ PASSED ] 3 tests. 2026-02-24T17:25:44.987 INFO:tasks.workunit.client.0.trial120.stdout:lient.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial120-20482-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:44.987 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.954556+0000 mon.b [INF] from='client.? 10.20.193.120:0/972522485' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial120-20230-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.954597+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial120-20482-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.954738+0000 mon.b [INF] from='client.? 10.20.193.120:0/4235396451' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20631-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.954847+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial120-20230-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.955086+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20631-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.955409+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20374-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.955673+0000 mon.b [INF] from='client.? 10.20.193.120:0/3253354025' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial120-20374-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.956252+0000 client.admin [INF] threexx 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.956315+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: got: 2026-02-24T17:25:41.962581+0000 mon.c [INF] from='client.? 10.20.193.120:0/1210529451' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (7067 ms) 2026-02-24T17:25:44.988 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (9425 ms total) 2026-02-24T17:25:44.989 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: 2026-02-24T17:25:44.989 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-24T17:25:44.989 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (9425 ms total) 2026-02-24T17:25:44.989 INFO:tasks.workunit.client.0.trial120.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-24T17:25:45.490 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:25:45.486+0000 7f1f4e0e7640 -1 osd.1 40 handle_osd_map injecting map crc failure 2026-02-24T17:25:45.505 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: Running main() from gmock_main.cc 2026-02-24T17:25:45.505 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-24T17:25:45.505 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [----------] Global test environment set-up. 2026-02-24T17:25:45.505 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-24T17:25:45.505 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-24T17:25:45.505 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (4360 ms) 2026-02-24T17:25:45.505 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-24T17:25:45.506 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (5547 ms) 2026-02-24T17:25:45.506 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (9907 ms total) 2026-02-24T17:25:45.506 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: 2026-02-24T17:25:45.506 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [----------] Global test environment tear-down 2026-02-24T17:25:45.506 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (9907 ms total) 2026-02-24T17:25:45.506 INFO:tasks.workunit.client.0.trial120.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-24T17:25:45.604 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=10 2026-02-24T17:25:45.604 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_asio (PID 20257)... waited 10 seconds' 2026-02-24T17:25:45.605 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_asio (PID 20257)... waited 10 seconds 2026-02-24T17:25:45.606 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 10 -ge 5400 ']' 2026-02-24T17:25:45.606 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20257 2026-02-24T17:25:45.606 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20257 2026-02-24T17:25:45.606 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:25:45.606 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:25:45.606 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:25:45.606 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:25:45.606 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20379 2026-02-24T17:25:45.607 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_snapshots (PID 20379)...' 2026-02-24T17:25:45.607 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_snapshots (PID 20379)... 2026-02-24T17:25:45.607 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20379 2026-02-24T17:25:45.607 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: Running main() from gmock_main.cc 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: [----------] Global test environment set-up. 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ OK ] NeoRadosPools.PoolList (1326 ms) 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (1990 ms) 2026-02-24T17:25:46.506 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2005 ms) 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2015 ms) 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (1546 ms) 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2008 ms) 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [----------] 6 tests from NeoRadosPools (10894 ms total) 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [----------] Global test environment tear-down 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [==========] 6 tests from 1 test suite ran. (10894 ms total) 2026-02-24T17:25:46.507 INFO:tasks.workunit.client.0.trial120.stdout: pool: [ PASSED ] 6 tests. 2026-02-24T17:25:46.760 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-24T17:25:46.760 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-24T17:25:46.760 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-24T17:25:46.760 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-24T17:25:46.760 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-24T17:25:46.760 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: notify 2026-02-24T17:25:46.760 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1024 ms) 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (3 ms) 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1027 ms total) 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: notify 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (26 ms) 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: notify 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3557 ms) 2026-02-24T17:25:46.761 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (3 ms) 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (4 ms) 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435209120 notify_id 180388626433 notifier_gid 5248 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (210 ms) 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435209120 notify_id 180388626434 notifier_gid 5248 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (4 ms) 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435209120 notify_id 180388626432 notifier_gid 5248 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435209120 notify_id 180388626433 notifier_gid 5248 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (5 ms) 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-24T17:25:46.762 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435212032 notify_id 180388626434 notifier_gid 5248 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (4 ms) 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435212032 notify_id 180388626432 notifier_gid 5248 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (5 ms) 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435212032 notify_id 180388626435 notifier_gid 5248 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (3 ms) 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-24T17:25:46.763 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: trying... 2026-02-24T17:25:47.497 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:25:47.492+0000 7fce61347640 -1 osd.6 42 handle_osd_map injecting map crc failure 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435212032 notify_id 180388626433 notifier_ api_lock: Running main() from gmock_main.cc 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [----------] Global test environment set-up. 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (43 ms) 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLock.LockShared (13 ms) 2026-02-24T17:25:47.513 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1037 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1003 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (3 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLock.Unlock (3 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (2 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (2 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [----------] 8 tests from LibRadosLock (2108 ms total) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (563 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (205 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1002 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1003 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (2 ms) 2026-02-24T17:25:47.514 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (3 ms) 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (206 ms) 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (2 ms) 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (2990 ms total) 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [----------] Global test environment tear-down 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (11978 ms total) 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: Running main() from gmock_main.cc 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: seed 20293 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (51 ms) 2026-02-24T17:25:47.515 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (1 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1004 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1004 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (2 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (2 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (2 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (2 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2073 ms total) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (564 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (2 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1005 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1003 ms) 2026-02-24T17:25:47.516 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (9 ms) 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (2 ms) 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (3 ms) 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (1 ms) 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (2595 ms total) 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (11975 ms total) 2026-02-24T17:25:47.517 INFO:tasks.workunit.client.0.trial120.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-24T17:25:48.497 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:25:48.491+0000 7f5986ab2640 -1 osd.0 43 handle_osd_map injecting map crc failure 2026-02-24T17:25:48.502 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:25:48.500+0000 7fce61347640 -1 osd.6 43 handle_osd_map injecting map crc failure 2026-02-24T17:25:49.503 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:25:49.500+0000 7fe8128dc640 -1 osd.4 44 handle_osd_map injecting map crc failure 2026-02-24T17:25:49.503 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:25:49.500+0000 7ff66534f640 -1 osd.8 44 handle_osd_map injecting map crc failure 2026-02-24T17:25:50.504 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:25:50.506+0000 7f1f4e0e7640 -1 osd.1 45 handle_osd_map injecting map crc failure 2026-02-24T17:25:51.511 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:25:51.512+0000 7fb6af2ac640 -1 osd.2 46 handle_osd_map injecting map crc failure 2026-02-24T17:25:52.511 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:25:52.508+0000 7fe8128dc640 -1 osd.4 47 handle_osd_map injecting map crc failure 2026-02-24T17:25:52.511 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:25:52.508+0000 7f9cfbed1640 -1 osd.3 47 handle_osd_map injecting map crc failure 2026-02-24T17:25:52.523 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: Running main() from gmock_main.cc 2026-02-24T17:25:52.523 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-24T17:25:52.523 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [----------] Global test environment set-up. 2026-02-24T17:25:52.523 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-24T17:25:52.523 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (5329 ms) 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (5569 ms) 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (6024 ms) 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [----------] 3 tests from NeoradosECList (16924 ms total) 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [----------] Global test environment tear-down 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (16924 ms total) 2026-02-24T17:25:52.524 INFO:tasks.workunit.client.0.trial120.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout:o_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (1 ms) 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (4 ms) 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (2 ms) 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (2 ms) 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-24T17:25:52.526 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (1 ms) 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (2 ms) 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (2 ms) 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (1 ms) 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (6 ms) 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (7505 ms) 2026-02-24T17:25:52.527 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1019 ms) 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (5 ms) 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (4 ms) 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (2 ms) 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (9610 ms total) 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (16999 ms total) 2026-02-24T17:25:52.528 INFO:tasks.workunit.client.0.trial120.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-24T17:25:53.480 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:25:53.476+0000 7fbba8012640 -1 osd.12 48 handle_osd_map injecting map crc failure 2026-02-24T17:25:53.483 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:25:53.484+0000 7fb6af2ac640 -1 osd.2 48 handle_osd_map injecting map crc failure 2026-02-24T17:25:53.485 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:25:53.484+0000 7fb6ad2a8640 -1 osd.2 48 handle_osd_map injecting map crc failure 2026-02-24T17:25:54.483 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:25:54.480+0000 7fbba8012640 -1 osd.12 49 handle_osd_map injecting map crc failure 2026-02-24T17:25:54.496 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-24T17:25:54.496 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-24T17:25:54.496 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-24T17:25:54.496 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify_test_cb 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (56 ms) 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94538130507344 err -107 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1043 ms) 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94538129473488 err -107 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1003 ms) 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 146028888065 cookie 94538129482480 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 146028888066 cookie 94538129482480 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (4 ms) 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 146028888064 cookie 94538130555024 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (3 ms) 2026-02-24T17:25:54.497 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 146028888064 cookie 94538130555024 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (4 ms) 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 146028888065 cookie 94538130561920 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 146028888065 cookie 94538130564592 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (4 ms) 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 146028888064 cookie 94538130561920 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 150323855361 cookie 94538130561920 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 150323855361 cookie 94538130561920 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 150323855362 cookie 94538130561920 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3004 ms) 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94538130561920 err -107 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_cb from 4711 notify_id 180388626437 cookie 94538130561920 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5006 ms) 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94538130561920 err -107 2026-02-24T17:25:54.498 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1003 ms) 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11134 ms total) 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: watch_notify_test_cb 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1020 ms) 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1020 ms total) 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (18939 ms total) 2026-02-24T17:25:54.499 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-24T17:25:55.606 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=10 2026-02-24T17:25:55.606 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_snapshots (PID 20379)... waited 10 seconds' 2026-02-24T17:25:55.607 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_snapshots (PID 20379)... waited 10 seconds 2026-02-24T17:25:55.607 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 10 -ge 5400 ']' 2026-02-24T17:25:55.607 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20379 2026-02-24T17:25:55.608 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:25:56.488 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:25:56.487+0000 7fce6334b640 -1 osd.6 51 handle_osd_map injecting map crc failure 2026-02-24T17:25:56.497 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-24T17:25:56.497 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-24T17:25:56.497 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (2352 ms) 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3011 ms) 2026-02-24T17:25:56.498 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (2550 ms) 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3013 ms) 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3013 ms) 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3005 ms) 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (3978 ms) 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (20925 ms total) 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-24T17:25:56.499 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (20925 ms total) 2026-02-24T17:25:56.500 INFO:tasks.workunit.client.0.trial120.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-24T17:25:57.490 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:25:57.489+0000 7fe8128dc640 -1 osd.4 52 handle_osd_map injecting map crc failure 2026-02-24T17:25:57.491 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:25:57.491+0000 7fce6334b640 -1 osd.6 52 handle_osd_map injecting map crc failure 2026-02-24T17:25:57.498 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-24T17:25:57.498 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: handle_notify cookie 94089338466320 notify_id 137438953472 notifier_gid 4830 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (2305 ms) 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: Trying... 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: handle_notify cookie 94089350211600 notify_id 150323855360 notifier_gid 4955 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: Waiting for 3.000000000s 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: Timed out. 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: Flushing... 2026-02-24T17:25:57.499 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: Flushed... 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6572 ms) 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (8878 ms total) 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (3013 ms) 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (4012 ms) 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (2977 ms) 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-24T17:25:57.500 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (3003 ms) 2026-02-24T17:25:57.501 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (13006 ms total) 2026-02-24T17:25:57.501 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: 2026-02-24T17:25:57.501 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-24T17:25:57.501 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (21884 ms total) 2026-02-24T17:25:57.501 INFO:tasks.workunit.client.0.trial120.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-24T17:25:58.492 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:25:58.489+0000 7f5986ab2640 -1 osd.0 53 handle_osd_map injecting map crc failure 2026-02-24T17:25:58.492 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:25:58.494+0000 7f8fc2cb5640 -1 osd.13 53 handle_osd_map injecting map crc failure 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: Running main() from gmock_main.cc 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [----------] Global test environment set-up. 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (2303 ms) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3012 ms) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (2556 ms) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3015 ms) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (3007 ms) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (3008 ms) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (3980 ms) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (2004 ms) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (22887 ms total) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [----------] Global test environment tear-down 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (22888 ms total) 2026-02-24T17:25:58.505 INFO:tasks.workunit.client.0.trial120.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] Global test environment set-up. 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: unable to get monitor info from DNS SRV with service name: 2026-02-24T17:25:35.557+0000 7f0205877980 -1 failed for service _ceph-mon._tcp 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: ceph-mon 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: 2026-02-24T17:25:35.557+0000 7f0205877980 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (21 ms) 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5003 ms) 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5024 ms total) 2026-02-24T17:25:58.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: started 0x556567d81af0 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: started 0x5565671368e0 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: started 2 aios 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: waiting 0x556567d81af0 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: waiting 0x5565671368e0 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: done. 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (4934 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (4934 ms total) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMisc.Exec (14 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (4 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (1 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4992 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (5682 ms) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] 8 tests from LibRadosMisc (10695 ms total) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [----------] Global test environment tear-down 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (22957 ms total) 2026-02-24T17:25:58.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-24T17:25:59.495 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:25:59.494+0000 7fed2dec0640 -1 osd.9 54 handle_osd_map injecting map crc failure 2026-02-24T17:26:00.497 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:26:00.498+0000 7fed2dec0640 -1 osd.9 55 handle_osd_map injecting map crc failure 2026-02-24T17:26:00.497 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:00.495+0000 7f9b6717a640 -1 osd.15 55 handle_osd_map injecting map crc failure 2026-02-24T17:26:01.501 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:01.499+0000 7fb6af2ac640 -1 osd.2 56 handle_osd_map injecting map crc failure 2026-02-24T17:26:02.503 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:26:02.499+0000 7fd22d90c640 -1 osd.11 57 handle_osd_map injecting map crc failure 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout:gid 5248 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: timed out 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: flushing 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: flushed 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3003 ms) 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: trying... 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435212032 notify_id 193273528326 notifier_gid 5248 2026-02-24T17:26:02.508 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: timed out 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: flushing 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: flushed 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3003 ms) 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: List watches 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: notify2 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435212032 notify_id 206158430210 notifier_gid 5248 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: notify2 done 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: watch_check 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: unwatch2 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: flushing 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: done 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3009 ms) 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: List watches 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: notify2 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: handle_notify cookie 94185435212032 notify_id 219043332100 notifier_gid 5248 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: notify2 done 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: watch_check 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: unwatch2 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: flushing 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: done 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3004 ms) 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (15845 ms total) 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (26947 ms total) 2026-02-24T17:26:02.509 INFO:tasks.workunit.client.0.trial120.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-24T17:26:03.025 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2026-02-24T17:26:03.025 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [----------] Global test environment set-up. 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5047 ms) 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ OK ] LibRadosService.RegisterLate (33 ms) 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: cluster: 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: id: f24f61d3-eddb-4c62-878a-4823ddf02ae6 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: health: HEALTH_OK 2026-02-24T17:26:03.026 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: services: 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 47s) [leader: a] 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: mgr: x(active, since 45s), standbys: y 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: osd: 16 osds: 16 up (since 40s), 16 in (since 44s) 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: data: 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: pools: 24 pools, 665 pgs 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: objects: 4 objects, 577 KiB 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: usage: 426 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: pgs: 55.338% pgs unknown 2026-02-24T17:26:03.027 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 43.308% pgs not active 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 368 unknown 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 288 creating+peering 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 9 active+clean 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: cluster: 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: id: f24f61d3-eddb-4c62-878a-4823ddf02ae6 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: health: HEALTH_OK 2026-02-24T17:26:03.028 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.029 INFO:tasks.workunit.client.0.trial120.stdout: api_service: services: 2026-02-24T17:26:03.029 INFO:tasks.workunit.client.0.trial120.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 49s) [leader: a] 2026-02-24T17:26:03.029 INFO:tasks.workunit.client.0.trial120.stdout: api_service: mgr: x(active, since 47s), standbys: y 2026-02-24T17:26:03.029 INFO:tasks.workunit.client.0.trial120.stdout: api_service: osd: 16 osds: 16 up (since 42s), 16 in (since 46s) 2026-02-24T17:26:03.029 INFO:tasks.workunit.client.0.trial120.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-24T17:26:03.029 INFO:tasks.workunit.client.0.trial120.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-24T17:26:03.029 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: data: 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: pools: 19 pools, 457 pgs 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: objects: 66 objects, 145 MiB 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: usage: 720 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: pgs: 28.009% pgs not active 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 329 active+clean 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 128 creating+peering 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: io: 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: client: 12 MiB/s rd, 37 MiB/s wr, 255 op/s rd, 293 op/s wr 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.030 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.031 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2332 ms) 2026-02-24T17:26:03.031 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-24T17:26:03.031 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ OK ] LibRadosService.Status (20033 ms) 2026-02-24T17:26:03.031 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [----------] 4 tests from LibRadosService (27447 ms total) 2026-02-24T17:26:03.031 INFO:tasks.workunit.client.0.trial120.stdout: api_service: 2026-02-24T17:26:03.031 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [----------] Global test environment tear-down 2026-02-24T17:26:03.031 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27447 ms total) 2026-02-24T17:26:03.031 INFO:tasks.workunit.client.0.trial120.stdout: api_service: [ PASSED ] 4 tests. 2026-02-24T17:26:03.483 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:26:03.483+0000 7f72dede7640 -1 osd.10 58 handle_osd_map injecting map crc failure 2026-02-24T17:26:04.482 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:26:04.481+0000 7f1f4e0e7640 -1 osd.1 59 handle_osd_map injecting map crc failure 2026-02-24T17:26:05.487 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:26:05.482+0000 7ff66534f640 -1 osd.8 60 handle_osd_map injecting map crc failure 2026-02-24T17:26:05.607 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=20 2026-02-24T17:26:05.608 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_snapshots (PID 20379)... waited 20 seconds' 2026-02-24T17:26:05.608 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_snapshots (PID 20379)... waited 20 seconds 2026-02-24T17:26:05.609 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 20 -ge 5400 ']' 2026-02-24T17:26:05.609 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20379 2026-02-24T17:26:05.609 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5040 ms) 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (31 ms) 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20029 ms) 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: attempt 0 of 20 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5046 ms) 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30148 ms total) 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-24T17:26:05.722 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30148 ms total) 2026-02-24T17:26:05.723 INFO:tasks.workunit.client.0.trial120.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-24T17:26:06.490 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:06.491+0000 7fb6af2ac640 -1 osd.2 61 handle_osd_map injecting map crc failure 2026-02-24T17:26:07.491 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:26:07.489+0000 7f1f4e0e7640 -1 osd.1 62 handle_osd_map injecting map crc failure 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: Running main() from gmock_main.cc 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: [----------] Global test environment set-up. 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.Version (1325 ms) 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (1992 ms) 2026-02-24T17:26:07.507 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.LongName (3033 ms) 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (2534 ms) 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3012 ms) 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3014 ms) 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.Exec (2973 ms) 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3003 ms) 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-24T17:26:07.508 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (3007 ms) 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3005 ms) 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (1990 ms) 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (2999 ms) 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [----------] 12 tests from NeoRadosMisc (31891 ms total) 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [----------] Global test environment tear-down 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [==========] 12 tests from 1 test suite ran. (31892 ms total) 2026-02-24T17:26:07.509 INFO:tasks.workunit.client.0.trial120.stdout: misc: [ PASSED ] 12 tests. 2026-02-24T17:26:08.495 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:08.490+0000 7fe8128dc640 -1 osd.4 63 handle_osd_map injecting map crc failure 2026-02-24T17:26:08.495 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:26:08.490+0000 7ff66534f640 -1 osd.8 63 handle_osd_map injecting map crc failure 2026-02-24T17:26:10.496 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:10.495+0000 7fe8128dc640 -1 osd.4 65 handle_osd_map injecting map crc failure 2026-02-24T17:26:10.497 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:26:10.495+0000 7f4dd23ca640 -1 osd.14 65 handle_osd_map injecting map crc failure 2026-02-24T17:26:12.501 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:26:12.499+0000 7fce6334b640 -1 osd.6 67 handle_osd_map injecting map crc failure 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: Running main() from gmock_main.cc 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [----------] Global test environment set-up. 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2378 ms) 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3007 ms) 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (2556 ms) 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3022 ms) 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3006 ms) 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (4986 ms) 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-24T17:26:12.512 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (4999 ms) 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (4996 ms) 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8010 ms) 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [----------] 9 tests from LibRadosPools (36964 ms total) 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [----------] Global test environment tear-down 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (36964 ms total) 2026-02-24T17:26:12.513 INFO:tasks.workunit.client.0.trial120.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-24T17:26:13.481 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:26:13.479+0000 7f9cfbed1640 -1 osd.3 68 handle_osd_map injecting map crc failure 2026-02-24T17:26:13.482 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:26:13.481+0000 7f1f4e0e7640 -1 osd.1 68 handle_osd_map injecting map crc failure 2026-02-24T17:26:13.485 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:26:13.483+0000 7f09b1cb0640 -1 osd.7 68 handle_osd_map injecting map crc failure 2026-02-24T17:26:14.485 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:26:14.483+0000 7fbba8012640 -1 osd.12 69 handle_osd_map injecting map crc failure 2026-02-24T17:26:14.486 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:14.483+0000 7f9b6717a640 -1 osd.15 69 handle_osd_map injecting map crc failure 2026-02-24T17:26:14.486 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:14.486+0000 7fb6ad2a8640 -1 osd.2 69 handle_osd_map injecting map crc failure 2026-02-24T17:26:15.486 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:26:15.483+0000 7fd22d90c640 -1 osd.11 70 handle_osd_map injecting map crc failure 2026-02-24T17:26:15.487 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:15.483+0000 7f9b6717a640 -1 osd.15 70 handle_osd_map injecting map crc failure 2026-02-24T17:26:15.488 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:26:15.486+0000 7fce6334b640 -1 osd.6 70 handle_osd_map injecting map crc failure 2026-02-24T17:26:15.609 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=30 2026-02-24T17:26:15.609 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_snapshots (PID 20379)... waited 30 seconds' 2026-02-24T17:26:15.609 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_snapshots (PID 20379)... waited 30 seconds 2026-02-24T17:26:15.610 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 30 -ge 5400 ']' 2026-02-24T17:26:15.610 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20379 2026-02-24T17:26:15.610 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:26:16.488 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:16.486+0000 7fb6af2ac640 -1 osd.2 71 handle_osd_map injecting map crc failure 2026-02-24T17:26:16.490 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:26:16.489+0000 7f1f4c0e3640 -1 osd.1 71 handle_osd_map injecting map crc failure 2026-02-24T17:26:16.493 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:16.491+0000 7f9b65176640 -1 osd.15 71 handle_osd_map injecting map crc failure 2026-02-24T17:26:16.503 INFO:tasks.workunit.client.0.trial120.stdout: io: Running main() from gmock_main.cc 2026-02-24T17:26:16.503 INFO:tasks.workunit.client.0.trial120.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-24T17:26:16.503 INFO:tasks.workunit.client.0.trial120.stdout: io: [----------] Global test environment set-up. 2026-02-24T17:26:16.503 INFO:tasks.workunit.client.0.trial120.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.Limits (2324 ms) 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (3011 ms) 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.ReadOp (2556 ms) 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.SparseRead (3016 ms) 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-24T17:26:16.504 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.RoundTrip (3007 ms) 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (3008 ms) 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (2982 ms) 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (3001 ms) 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (3004 ms) 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.Trunc (2991 ms) 2026-02-24T17:26:16.505 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.Remove (2997 ms) 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3011 ms) 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.RmXattr (2981 ms) 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3006 ms) 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [----------] 14 tests from NeoRadosIo (40902 ms total) 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [----------] Global test environment tear-down 2026-02-24T17:26:16.506 INFO:tasks.workunit.client.0.trial120.stdout: io: [==========] 14 tests from 1 test suite ran. (40902 ms total) 2026-02-24T17:26:16.507 INFO:tasks.workunit.client.0.trial120.stdout: io: [ PASSED ] 14 tests. 2026-02-24T17:26:17.490 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:26:17.486+0000 7f72dede7640 -1 osd.10 72 handle_osd_map injecting map crc failure 2026-02-24T17:26:19.493 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:26:19.491+0000 7f9cfbed1640 -1 osd.3 74 handle_osd_map injecting map crc failure 2026-02-24T17:26:19.500 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:26:19.495+0000 7f09b1cb0640 -1 osd.7 74 handle_osd_map injecting map crc failure 2026-02-24T17:26:19.508 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: Running main() from gmock_main.cc 2026-02-24T17:26:19.508 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-24T17:26:19.508 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [----------] Global test environment set-up. 2026-02-24T17:26:19.508 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-24T17:26:19.508 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (2307 ms) 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3011 ms) 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (2557 ms) 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (3013 ms) 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (3009 ms) 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-24T17:26:19.509 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (3009 ms) 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (2978 ms) 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (3004 ms) 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (3005 ms) 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (2991 ms) 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (2999 ms) 2026-02-24T17:26:19.510 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3013 ms) 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2977 ms) 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3006 ms) 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (3005 ms) 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (43890 ms total) 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [----------] Global test environment tear-down 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (43890 ms total) 2026-02-24T17:26:19.511 INFO:tasks.workunit.client.0.trial120.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-24T17:26:20.495 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:20.494+0000 7fb6af2ac640 -1 osd.2 75 handle_osd_map injecting map crc failure 2026-02-24T17:26:21.498 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:26:21.494+0000 7fce6334b640 -1 osd.6 76 handle_osd_map injecting map crc failure 2026-02-24T17:26:21.499 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:26:21.497+0000 7f8fc2cb5640 -1 osd.13 76 handle_osd_map injecting map crc failure 2026-02-24T17:26:24.486 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:26:24.488+0000 7f5986ab2640 -1 osd.0 79 handle_osd_map injecting map crc failure 2026-02-24T17:26:24.486 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:26:24.483+0000 7f9cfbed1640 -1 osd.3 79 handle_osd_map injecting map crc failure 2026-02-24T17:26:24.487 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:24.483+0000 7f9b6717a640 -1 osd.15 79 handle_osd_map injecting map crc failure 2026-02-24T17:26:25.486 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:26:25.485+0000 7fed2dec0640 -1 osd.9 80 handle_osd_map injecting map crc failure 2026-02-24T17:26:25.610 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=40 2026-02-24T17:26:25.610 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_snapshots (PID 20379)... waited 40 seconds' 2026-02-24T17:26:25.611 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_snapshots (PID 20379)... waited 40 seconds 2026-02-24T17:26:25.611 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 40 -ge 5400 ']' 2026-02-24T17:26:25.611 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20379 2026-02-24T17:26:25.611 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:26:26.495 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:26.496+0000 7fe8128dc640 -1 osd.4 81 handle_osd_map injecting map crc failure 2026-02-24T17:26:27.499 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:26:27.500+0000 7f5986ab2640 -1 osd.0 82 handle_osd_map injecting map crc failure 2026-02-24T17:26:28.504 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:26:28.502+0000 7f72dcde3640 -1 osd.10 83 handle_osd_map injecting map crc failure 2026-02-24T17:26:28.507 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:26:28.505+0000 7fb7cc2d9640 -1 osd.5 83 handle_osd_map injecting map crc failure 2026-02-24T17:26:29.504 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:26:29.505+0000 7f8fc2cb5640 -1 osd.13 84 handle_osd_map injecting map crc failure 2026-02-24T17:26:29.506 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:26:29.508+0000 7ff66534f640 -1 osd.8 84 handle_osd_map injecting map crc failure 2026-02-24T17:26:29.510 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:26:29.509+0000 7fb7cc2d9640 -1 osd.5 84 handle_osd_map injecting map crc failure 2026-02-24T17:26:29.516 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: Running main() from gmock_main.cc 2026-02-24T17:26:29.516 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-24T17:26:29.516 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-24T17:26:29.516 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-24T17:26:29.516 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-24T17:26:29.516 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2007 ms) 2026-02-24T17:26:29.516 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-24T17:26:29.516 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2003 ms) 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2014 ms) 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (1548 ms) 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (7574 ms total) 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4030 ms) 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-24T17:26:29.517 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3969 ms) 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (6011 ms) 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (14011 ms total) 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (3007 ms) 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2004 ms) 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2002 ms) 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-24T17:26:29.518 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1982 ms) 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8998 ms total) 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (3995 ms) 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4015 ms) 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8010 ms total) 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-24T17:26:29.519 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (53969 ms total) 2026-02-24T17:26:29.520 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-24T17:26:30.506 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:26:30.508+0000 7ff66534f640 -1 osd.8 85 handle_osd_map injecting map crc failure 2026-02-24T17:26:30.506 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:26:30.508+0000 7fbba8012640 -1 osd.12 85 handle_osd_map injecting map crc failure 2026-02-24T17:26:30.507 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:26:30.505+0000 7f1f4e0e7640 -1 osd.1 85 handle_osd_map injecting map crc failure 2026-02-24T17:26:30.507 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:26:30.502+0000 7f4dd23ca640 -1 osd.14 85 handle_osd_map injecting map crc failure 2026-02-24T17:26:30.507 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:26:30.505+0000 7f8fc2cb5640 -1 osd.13 85 handle_osd_map injecting map crc failure 2026-02-24T17:26:30.508 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:26:30.508+0000 7fbba600e640 -1 osd.12 85 handle_osd_map injecting map crc failure 2026-02-24T17:26:31.510 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:31.512+0000 7fe8128dc640 -1 osd.4 86 handle_osd_map injecting map crc failure 2026-02-24T17:26:32.512 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:32.510+0000 7fb6af2ac640 -1 osd.2 87 handle_osd_map injecting map crc failure 2026-02-24T17:26:32.513 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:32.510+0000 7fb6ad2a8640 -1 osd.2 87 handle_osd_map injecting map crc failure 2026-02-24T17:26:35.517 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:26:35.516+0000 7ff66534f640 -1 osd.8 90 handle_osd_map injecting map crc failure 2026-02-24T17:26:35.517 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:26:35.510+0000 7fd22d90c640 -1 osd.11 90 handle_osd_map injecting map crc failure 2026-02-24T17:26:35.612 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=50 2026-02-24T17:26:35.612 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_snapshots (PID 20379)... waited 50 seconds' 2026-02-24T17:26:35.612 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_snapshots (PID 20379)... waited 50 seconds 2026-02-24T17:26:35.612 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 50 -ge 5400 ']' 2026-02-24T17:26:35.612 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20379 2026-02-24T17:26:35.612 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20379 2026-02-24T17:26:35.612 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test delete_pools_parallel (PID 20739)... 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20739 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test delete_pools_parallel (PID 20739)...' 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20739 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20739 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20526 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_cmd_pp (PID 20526)... 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_cmd_pp (PID 20526)...' 2026-02-24T17:26:35.613 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20526 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20526 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20428 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_stat_pp (PID 20428)...' 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_stat_pp (PID 20428)... 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20428 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20428 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_misc (PID 20303)... 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20303 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_misc (PID 20303)...' 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20303 2026-02-24T17:26:35.614 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20303 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20470 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_watch_notify_pp (PID 20470)...' 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_watch_notify_pp (PID 20470)... 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20470 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20470 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20807 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test io (PID 20807)... 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test io (PID 20807)...' 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20807 2026-02-24T17:26:35.615 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20807 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20823 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test ec_io (PID 20823)... 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test ec_io (PID 20823)...' 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20823 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20823 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20326 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_misc_pp (PID 20326)... 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_misc_pp (PID 20326)...' 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20326 2026-02-24T17:26:35.616 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:26:36.528 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:36.522+0000 7f9b6717a640 -1 osd.15 91 handle_osd_map injecting map crc failure 2026-02-24T17:26:36.528 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:26:36.529+0000 7fed2dec0640 -1 osd.9 91 handle_osd_map injecting map crc failure 2026-02-24T17:26:36.528 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:26:36.526+0000 7fce6334b640 -1 osd.6 91 handle_osd_map injecting map crc failure 2026-02-24T17:26:36.528 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:26:36.528+0000 7fbba8012640 -1 osd.12 91 handle_osd_map injecting map crc failure 2026-02-24T17:26:36.548 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:26:36.546+0000 7f72dede7640 -1 osd.10 91 handle_osd_map injecting map crc failure 2026-02-24T17:26:37.518 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:26:37.517+0000 7fed2dec0640 -1 osd.9 92 handle_osd_map injecting map crc failure 2026-02-24T17:26:37.523 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:26:37.521+0000 7f1f4c0e3640 -1 osd.1 92 handle_osd_map injecting map crc failure 2026-02-24T17:26:37.524 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:26:37.518+0000 7fd22b908640 -1 osd.11 92 handle_osd_map injecting map crc failure 2026-02-24T17:26:38.522 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:38.518+0000 7fb6af2ac640 -1 osd.2 93 handle_osd_map injecting map crc failure 2026-02-24T17:26:39.522 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:39.524+0000 7fe8128dc640 -1 osd.4 94 handle_osd_map injecting map crc failure 2026-02-24T17:26:39.522 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:26:39.520+0000 7f8fc2cb5640 -1 osd.13 94 handle_osd_map injecting map crc failure 2026-02-24T17:26:40.523 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:40.521+0000 7fb6af2ac640 -1 osd.2 95 handle_osd_map injecting map crc failure 2026-02-24T17:26:41.527 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:26:41.525+0000 7f4dd23ca640 -1 osd.14 96 handle_osd_map injecting map crc failure 2026-02-24T17:26:41.527 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:41.525+0000 7fb6af2ac640 -1 osd.2 96 handle_osd_map injecting map crc failure 2026-02-24T17:26:42.527 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:26:42.525+0000 7fce6334b640 -1 osd.6 97 handle_osd_map injecting map crc failure 2026-02-24T17:26:42.528 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:42.522+0000 7f9b6717a640 -1 osd.15 97 handle_osd_map injecting map crc failure 2026-02-24T17:26:43.486 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:26:43.484+0000 7f8fc2cb5640 -1 osd.13 98 handle_osd_map injecting map crc failure 2026-02-24T17:26:43.489 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:26:43.488+0000 7fbba8012640 -1 osd.12 98 handle_osd_map injecting map crc failure 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [==========] Running 32 tests from 7 test suites. 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 23 tests from LibRadosMiscPP 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: seed 20337 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-24T17:26:43.495 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (64 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (5 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (5 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (3 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (17 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (1 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (1 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (1 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (5 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (1 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (2 ms) 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-24T17:26:43.496 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (3 ms) 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1000 ms) 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (267 ms) 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: done waiting, doing copies 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: done waiting 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60402 ms) 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (3 ms) 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (1 ms) 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4784 ms) 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-24T17:26:43.497 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-24T17:26:43.498 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-24T17:26:43.498 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-24T17:26:43.498 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-24T17:26:43.498 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-24T17:26:43.498 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.NoVer 2026-02-24T17:26:44.490 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2026-02-24T17:26:44.490 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-24T17:26:44.490 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: seed 20399 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (1991 ms) 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2006 ms) 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2013 ms) 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1547 ms) 2026-02-24T17:26:44.491 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4034 ms) 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (11593 ms total) 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4005 ms) 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3980 ms) 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (5990 ms) 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4009 ms) 2026-02-24T17:26:44.492 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2011 ms) 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial120-20399-7 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17979 ms) 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (37976 ms total) 2026-02-24T17:26:44.493 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (4 ms) 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5020 ms) 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5024 ms total) 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3007 ms) 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-24T17:26:44.494 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2000 ms) 2026-02-24T17:26:44.495 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-24T17:26:45.491 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:26:45.488+0000 7f8fc2cb5640 -1 osd.13 100 handle_osd_map injecting map crc failure 2026-02-24T17:26:45.492 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:45.492+0000 7fe8128dc640 -1 osd.4 100 handle_osd_map injecting map crc failure 2026-02-24T17:26:45.614 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=10 2026-02-24T17:26:45.614 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_misc_pp (PID 20326)... waited 10 seconds' 2026-02-24T17:26:45.615 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (1961 mWaiting for test api_misc_pp (PID 20326)... waited 10 seconds 2026-02-24T17:26:45.615 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 10 -ge 5400 ']' 2026-02-24T17:26:45.616 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20326 2026-02-24T17:26:45.616 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:26:46.492 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:46.489+0000 7fb6af2ac640 -1 osd.2 101 handle_osd_map injecting map crc failure 2026-02-24T17:26:47.495 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:47.493+0000 7fb6af2ac640 -1 osd.2 102 handle_osd_map injecting map crc failure 2026-02-24T17:26:49.497 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:26:49.493+0000 7f4dd23ca640 -1 osd.14 104 handle_osd_map injecting map crc failure 2026-02-24T17:26:49.498 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:26:49.500+0000 7f5986ab2640 -1 osd.0 104 handle_osd_map injecting map crc failure 2026-02-24T17:26:49.499 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:49.497+0000 7fb6af2ac640 -1 osd.2 104 handle_osd_map injecting map crc failure 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: Running main() from gmock_main.cc 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [----------] Global test environment set-up. 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (4316 ms) 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (4564 ms) 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-24T17:26:49.508 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4031 ms) 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (4964 ms) 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (7017 ms) 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (24895 ms total) 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (4986 ms) 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6012 ms) 2026-02-24T17:26:49.509 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (7996 ms) 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5992 ms) 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4019 ms) 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial120-21074-11. 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: Waiting for snaps to purge. 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19992 ms) 2026-02-24T17:26:49.510 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (48998 ms total) 2026-02-24T17:26:49.511 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: 2026-02-24T17:26:49.511 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [----------] Global test environment tear-down 2026-02-24T17:26:49.511 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (73893 ms total) 2026-02-24T17:26:49.511 INFO:tasks.workunit.client.0.trial120.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-24T17:26:50.499 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:50.497+0000 7fb6af2ac640 -1 osd.2 105 handle_osd_map injecting map crc failure 2026-02-24T17:26:51.501 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:26:51.500+0000 7fb7ce2dd640 -1 osd.5 106 handle_osd_map injecting map crc failure 2026-02-24T17:26:51.502 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:26:51.500+0000 7f8fc2cb5640 -1 osd.13 106 handle_osd_map injecting map crc failure 2026-02-24T17:26:51.503 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:51.504+0000 7fe8128dc640 -1 osd.4 106 handle_osd_map injecting map crc failure 2026-02-24T17:26:52.503 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:26:52.498+0000 7fd22d90c640 -1 osd.11 107 handle_osd_map injecting map crc failure 2026-02-24T17:26:52.504 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:26:52.498+0000 7fd22d90c640 -1 osd.11 107 handle_osd_map injecting map crc failure 2026-02-24T17:26:52.506 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:26:52.508+0000 7ff66334b640 -1 osd.8 107 handle_osd_map injecting map crc failure 2026-02-24T17:26:52.531 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:26:52.529+0000 7f72dede7640 -1 osd.10 107 handle_osd_map injecting map crc failure 2026-02-24T17:26:53.505 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:53.504+0000 7fe8128dc640 -1 osd.4 108 handle_osd_map injecting map crc failure 2026-02-24T17:26:53.506 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:53.502+0000 7f9b6717a640 -1 osd.15 108 handle_osd_map injecting map crc failure 2026-02-24T17:26:53.509 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:26:53.508+0000 7f5984aae640 -1 osd.0 108 handle_osd_map injecting map crc failure 2026-02-24T17:26:54.507 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:26:54.502+0000 7f9cfbed1640 -1 osd.3 109 handle_osd_map injecting map crc failure 2026-02-24T17:26:54.508 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:54.508+0000 7fe8128dc640 -1 osd.4 109 handle_osd_map injecting map crc failure 2026-02-24T17:26:55.616 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=20 2026-02-24T17:26:55.616 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_misc_pp (PID 20326)... waited 20 seconds' 2026-02-24T17:26:55.616 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_misc_pp (PID 20326)... waited 20 seconds 2026-02-24T17:26:55.617 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 20 -ge 5400 ']' 2026-02-24T17:26:55.617 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20326 2026-02-24T17:26:55.617 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:26:56.510 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:56.512+0000 7fe8128dc640 -1 osd.4 111 handle_osd_map injecting map crc failure 2026-02-24T17:26:56.511 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:26:56.508+0000 7f1f4e0e7640 -1 osd.1 111 handle_osd_map injecting map crc failure 2026-02-24T17:26:56.512 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:26:56.508+0000 7f8fc2cb5640 -1 osd.13 111 handle_osd_map injecting map crc failure 2026-02-24T17:26:56.512 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:26:56.509+0000 7fb6ad2a8640 -1 osd.2 111 handle_osd_map injecting map crc failure 2026-02-24T17:26:57.515 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:26:57.512+0000 7fb7cc2d9640 -1 osd.5 112 handle_osd_map injecting map crc failure 2026-02-24T17:26:57.515 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:26:57.510+0000 7fd22d90c640 -1 osd.11 112 handle_osd_map injecting map crc failure 2026-02-24T17:26:58.520 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:26:58.520+0000 7ff66534f640 -1 osd.8 113 handle_osd_map injecting map crc failure 2026-02-24T17:26:58.523 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: Running main() from gmock_main.cc 2026-02-24T17:26:58.523 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-24T17:26:58.523 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [----------] Global test environment set-up. 2026-02-24T17:26:58.523 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-24T17:26:58.523 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-24T17:26:58.523 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2393 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (3012 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (2555 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3013 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3010 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3006 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (2979 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (3003 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3014 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2983 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2998 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3013 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2980 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3003 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.Flush (3006 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3004 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (2987 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3015 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3007 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3004 ms) 2026-02-24T17:26:58.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3004 ms) 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3005 ms) 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2962 ms) 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3011 ms) 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3000 ms) 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3002 ms) 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (3007 ms) 2026-02-24T17:26:58.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-24T17:26:59.525 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:26:59.524+0000 7fe8128dc640 -1 osd.4 114 handle_osd_map injecting map crc failure 2026-02-24T17:26:59.526 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:59.522+0000 7f9b65176640 -1 osd.15 114 handle_osd_map injecting map crc failure 2026-02-24T17:26:59.528 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:26:59.522+0000 7f9b65176640 -1 osd.15 114 handle_osd_map injecting map crc failure 2026-02-24T17:27:01.537 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:27:01.533+0000 7fce6334b640 -1 osd.6 116 handle_osd_map injecting map crc failure 2026-02-24T17:27:05.495 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:27:05.496+0000 7fbba8012640 -1 osd.12 120 handle_osd_map injecting map crc failure 2026-02-24T17:27:05.504 INFO:tasks.workunit.client.0.trial120.stdout: apis) 2026-02-24T17:27:05.504 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-24T17:27:05.504 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2010 ms) 2026-02-24T17:27:05.504 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8980 ms total) 2026-02-24T17:27:05.504 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: 2026-02-24T17:27:05.504 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-24T17:27:05.504 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-24T17:27:05.504 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4012 ms) 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4009 ms) 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3975 ms) 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11997 ms total) 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (89951 ms total) 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-24T17:27:05.505 INFO:tasks.workunit.client.0.trial120.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T17:27:05.617 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=30 2026-02-24T17:27:05.617 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_misc_pp (PID 20326)... waited 30 seconds 2026-02-24T17:27:05.618 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_misc_pp (PID 20326)... waited 30 seconds' 2026-02-24T17:27:05.618 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 30 -ge 5400 ']' 2026-02-24T17:27:05.618 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20326 2026-02-24T17:27:05.618 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:27:07.502 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:27:07.497+0000 7f9b65176640 -1 osd.15 122 handle_osd_map injecting map crc failure 2026-02-24T17:27:08.509 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:27:08.508+0000 7f5986ab2640 -1 osd.0 123 handle_osd_map injecting map crc failure 2026-02-24T17:27:08.510 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:08.507+0000 7fed2dec0640 -1 osd.9 123 handle_osd_map injecting map crc failure 2026-02-24T17:27:08.517 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.NoVer (6 ms) 2026-02-24T17:27:08.518 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 23 tests from LibRadosMiscPP (66581 ms total) 2026-02-24T17:27:08.518 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: 2026-02-24T17:27:08.518 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-24T17:27:08.518 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-24T17:27:08.518 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (93 ms) 2026-02-24T17:27:08.518 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (93 ms total) 2026-02-24T17:27:08.519 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: 2026-02-24T17:27:08.519 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-24T17:27:08.519 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-24T17:27:08.519 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (7 ms) 2026-02-24T17:27:08.519 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-24T17:27:08.519 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (2 ms) 2026-02-24T17:27:08.519 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (9 ms total) 2026-02-24T17:27:08.519 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (6 ms) 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (1 ms) 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (8 ms total) 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-24T17:27:08.520 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (5 ms) 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (2 ms) 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (7 ms total) 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1006 ms) 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1006 ms total) 2026-02-24T17:27:08.521 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: 2026-02-24T17:27:08.522 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-24T17:27:08.522 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [==========] 32 tests from 7 test suites ran. (92966 ms total) 2026-02-24T17:27:08.522 INFO:tasks.workunit.client.0.trial120.stdout: api_misc_pp: [ PASSED ] 32 tests. 2026-02-24T17:27:10.502 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:27:10.496+0000 7fce6334b640 -1 osd.6 125 handle_osd_map injecting map crc failure 2026-02-24T17:27:10.502 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:27:10.496+0000 7fb6af2ac640 -1 osd.2 125 handle_osd_map injecting map crc failure 2026-02-24T17:27:11.151 INFO:tasks.workunit.client.0.trial120.stdout: cursor()=7:bd63b0f1:::8:head expected=7:bd63b0f1:::8:head 2026-02-24T17:27:11.151 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:bd63b0f1:::8:head -> 8 2026-02-24T17:27:11.151 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=8 expected=8 2026-02-24T17:27:11.151 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:b29083e3:::5:head 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:b29083e3:::5:head expected=7:b29083e3:::5:head 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:b29083e3:::5:head -> 5 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=5 expected=5 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:89d3ae78:::11:head 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:89d3ae78:::11:head expected=7:89d3ae78:::11:head 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:89d3ae78:::11:head -> 11 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=11 expected=11 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:863748b0:::15:head 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:863748b0:::15:head expected=7:863748b0:::15:head 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:863748b0:::15:head -> 15 2026-02-24T17:27:11.152 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=15 expected=15 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:6cac518f:::0:head 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:6cac518f:::0:head expected=7:6cac518f:::0:head 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:6cac518f:::0:head -> 0 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=0 expected=0 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:62a1935d:::14:head 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:62a1935d:::14:head expected=7:62a1935d:::14:head 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:62a1935d:::14:head -> 14 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=14 expected=14 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:5c6b0b28:::7:head 2026-02-24T17:27:11.153 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:5c6b0b28:::7:head expected=7:5c6b0b28:::7:head 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:5c6b0b28:::7:head -> 7 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=7 expected=7 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : seek to 7:566253c9:::13:head 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : cursor()=7:566253c9:::13:head expected=7:566253c9:::13:head 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: > 7:566253c9:::13:head -> 13 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: : entry=13 expected=13 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (155 ms) 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-24T17:27:11.154 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (46203 ms) 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: split 0/5 -> MIN 7:33333333::::head 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: split 1/5 -> 7:33333333::::head 7:66666666::::head 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: split 2/5 -> 7:66666666::::head 7:99999999::::head 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: split 3/5 -> 7:99999999::::head 7:cccccccc::::head 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: split 4/5 -> 7:cccccccc::::head MAX 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (42030 ms) 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [----------] 7 tests from LibRadosList (88634 ms total) 2026-02-24T17:27:11.155 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 2026-02-24T17:27:11.156 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-24T17:27:11.156 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-24T17:27:11.156 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1607 ms) 2026-02-24T17:27:11.156 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-24T17:27:11.156 INFO:tasks.workunit.client.0.trial120.stdout: api_list: myset foo1,foo2,foo3 2026-02-24T17:27:11.156 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo1 2026-02-24T17:27:11.156 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo2 2026-02-24T17:27:11.157 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo3 2026-02-24T17:27:11.157 INFO:tasks.workunit.client.0.trial120.stdout: api_list: myset foo1,foo4,foo5 2026-02-24T17:27:11.157 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo4 2026-02-24T17:27:11.157 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo5 2026-02-24T17:27:11.157 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo1 2026-02-24T17:27:11.157 INFO:tasks.workunit.client.0.trial120.stdout: api_list: myset foo6,foo7 2026-02-24T17:27:11.157 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo7 2026-02-24T17:27:11.157 INFO:tasks.workunit.client.0.trial120.stdout: api_list: foo6 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns1:foo4 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns1:foo5 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns2:foo7 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns2:foo6 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: ns1:foo1 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: :foo1 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: :foo2 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: :foo3 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (23 ms) 2026-02-24T17:27:11.158 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-24T17:27:11.159 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 1 0 2026-02-24T17:27:11.159 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 10 0 2026-02-24T17:27:11.159 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 13 0 2026-02-24T17:27:13.512 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:27:13.509+0000 7f9b6717a640 -1 osd.15 128 handle_osd_map injecting map crc failure 2026-02-24T17:27:13.513 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:27:13.509+0000 7f09b1cb0640 -1 osd.7 128 handle_osd_map injecting map crc failure 2026-02-24T17:27:14.515 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:27:14.515+0000 7fe8128dc640 -1 osd.4 129 handle_osd_map injecting map crc failure 2026-02-24T17:27:14.516 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:27:14.509+0000 7f09b3cb4640 -1 osd.7 129 handle_osd_map injecting map crc failure 2026-02-24T17:27:14.516 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:27:14.512+0000 7f4dd23ca640 -1 osd.14 129 handle_osd_map injecting map crc failure 2026-02-24T17:27:14.590 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:27:14.587+0000 7f1f4c0e3640 -1 osd.1 129 handle_osd_map injecting map crc failure 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 7 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 14 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 0 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 15 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 11 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 5 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 8 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 6 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 3 0 2026-02-24T17:27:15.523 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 4 0 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 12 0 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 9 0 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 2 0 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (33 ms) 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [----------] 3 tests from LibRadosListEC (1664 ms total) 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3004 ms) 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [----------] 1 test from LibRadosListNP (3004 ms total) 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [----------] Global test environment tear-down 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [==========] 11 tests from 3 test suites ran. (99983 ms total) 2026-02-24T17:27:15.524 INFO:tasks.workunit.client.0.trial120.stdout: api_list: [ PASSED ] 11 tests. 2026-02-24T17:27:15.618 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=40 2026-02-24T17:27:15.618 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_misc_pp (PID 20326)... waited 40 seconds' 2026-02-24T17:27:15.619 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_misc_pp (PID 20326)... waited 40 seconds 2026-02-24T17:27:15.620 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 40 -ge 5400 ']' 2026-02-24T17:27:15.620 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20326 2026-02-24T17:27:15.620 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20326 2026-02-24T17:27:15.620 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:27:15.620 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:27:15.620 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:27:15.620 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:27:15.620 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20760 2026-02-24T17:27:15.621 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test cls (PID 20760)...' 2026-02-24T17:27:15.621 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test cls (PID 20760)... 2026-02-24T17:27:15.622 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20760 2026-02-24T17:27:15.622 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20760 2026-02-24T17:27:15.622 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:27:15.622 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:27:15.622 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:27:15.622 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:27:15.622 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20241 2026-02-24T17:27:15.623 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_io (PID 20241)... 2026-02-24T17:27:15.623 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_io (PID 20241)...' 2026-02-24T17:27:15.624 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20241 2026-02-24T17:27:15.624 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20241 2026-02-24T17:27:15.624 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:27:15.624 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:27:15.624 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:27:15.624 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:27:15.624 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20273 2026-02-24T17:27:15.624 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_lock (PID 20273)...' 2026-02-24T17:27:15.625 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_lock (PID 20273)... 2026-02-24T17:27:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20273 2026-02-24T17:27:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20273 2026-02-24T17:27:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:27:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:27:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:27:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:27:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20675 2026-02-24T17:27:15.627 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test list_parallel (PID 20675)... 2026-02-24T17:27:15.627 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test list_parallel (PID 20675)...' 2026-02-24T17:27:15.628 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20675 2026-02-24T17:27:15.628 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20675 2026-02-24T17:27:15.628 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:27:15.628 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:27:15.628 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:27:15.628 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:27:15.628 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20233 2026-02-24T17:27:15.629 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_aio_pp (PID 20233)... 2026-02-24T17:27:15.629 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_aio_pp (PID 20233)...' 2026-02-24T17:27:15.629 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:27:15.629 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:27:15.779 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:27:15.779+0000 7ff66334b640 -1 osd.8 130 handle_osd_map injecting map crc failure 2026-02-24T17:27:16.518 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:27:16.519+0000 7f5984aae640 -1 osd.0 131 handle_osd_map injecting map crc failure 2026-02-24T17:27:16.521 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:27:16.513+0000 7f9b65176640 -1 osd.15 131 handle_osd_map injecting map crc failure 2026-02-24T17:27:16.826 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:27:16.824+0000 7fce61347640 -1 osd.6 131 handle_osd_map injecting map crc failure 2026-02-24T17:27:17.519 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:27:17.515+0000 7fb7ce2dd640 -1 osd.5 132 handle_osd_map injecting map crc failure 2026-02-24T17:27:18.523 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: Running main() from gmock_main.cc 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2402 ms) 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (22580 ms) 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-24T17:27:18.524 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (5991 ms) 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3005 ms) 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3006 ms) 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2984 ms) 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3013 ms) 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2997 ms) 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2987 ms) 2026-02-24T17:27:18.525 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3012 ms) 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3010 ms) 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3003 ms) 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3013 ms) 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (2994 ms) 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3006 ms) 2026-02-24T17:27:18.526 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2965 ms) 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3004 ms) 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3005 ms) 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3005 ms) 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3007 ms) 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3017 ms) 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-24T17:27:18.527 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2967 ms) 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2996 ms) 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3011 ms) 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3001 ms) 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3017 ms) 2026-02-24T17:27:18.528 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-24T17:27:19.521 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:27:19.516+0000 7f72dede7640 -1 osd.10 134 handle_osd_map injecting map crc failure 2026-02-24T17:27:20.523 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:20.519+0000 7fed2dec0640 -1 osd.9 135 handle_osd_map injecting map crc failure 2026-02-24T17:27:22.501 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:27:22.493+0000 7f9cf9ecd640 -1 osd.3 136 handle_osd_map injecting map crc failure 2026-02-24T17:27:23.528 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:27:23.524+0000 7fce6334b640 -1 osd.6 138 handle_osd_map injecting map crc failure 2026-02-24T17:27:23.528 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:27:23.527+0000 7fbba8012640 -1 osd.12 138 handle_osd_map injecting map crc failure 2026-02-24T17:27:24.778 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:27:24.773+0000 7fd22b908640 -1 osd.11 139 handle_osd_map injecting map crc failure 2026-02-24T17:27:25.140 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:27:25.139+0000 7fbba600e640 -1 osd.12 139 handle_osd_map injecting map crc failure 2026-02-24T17:27:25.339 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:27:25.335+0000 7f1f4c0e3640 -1 osd.1 139 handle_osd_map injecting map crc failure 2026-02-24T17:27:25.535 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:27:25.531+0000 7f1f4e0e7640 -1 osd.1 140 handle_osd_map injecting map crc failure 2026-02-24T17:27:25.539 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:27:25.535+0000 7fb7cc2d9640 -1 osd.5 139 handle_osd_map injecting map crc failure 2026-02-24T17:27:25.620 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=10 2026-02-24T17:27:25.620 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 10 seconds' 2026-02-24T17:27:25.620 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioWaiting for test api_aio_pp (PID 20233)... waited 10 seconds 2026-02-24T17:27:25.620 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 10 -ge 5400 ']' 2026-02-24T17:27:25.620 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:27:25.620 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:27:26.538 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:27:26.535+0000 7ff66534f640 -1 osd.8 141 handle_osd_map injecting map crc failure 2026-02-24T17:27:28.541 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:27:28.539+0000 7fe8108d8640 -1 osd.4 142 handle_osd_map injecting map crc failure 2026-02-24T17:27:28.543 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:27:28.543+0000 7fe8108d8640 -1 osd.4 142 handle_osd_map injecting map crc failure 2026-02-24T17:27:28.543 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:27:28.544+0000 7f4dd03c6640 -1 osd.14 142 handle_osd_map injecting map crc failure 2026-02-24T17:27:28.544 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:27:28.537+0000 7f9cf9ecd640 -1 osd.3 142 handle_osd_map injecting map crc failure 2026-02-24T17:27:30.542 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:27:30.539+0000 7fb7ce2dd640 -1 osd.5 145 handle_osd_map injecting map crc failure 2026-02-24T17:27:30.578 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:30.575+0000 7fed2bebc640 -1 osd.9 145 handle_osd_map injecting map crc failure 2026-02-24T17:27:31.739 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:27:31.737+0000 7f09b1cb0640 -1 osd.7 146 handle_osd_map injecting map crc failure 2026-02-24T17:27:34.551 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:27:34.552+0000 7fce6334b640 -1 osd.6 148 handle_osd_map injecting map crc failure 2026-02-24T17:27:34.691 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:27:34.691+0000 7ff66334b640 -1 osd.8 149 handle_osd_map injecting map crc failure 2026-02-24T17:27:35.621 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=20 2026-02-24T17:27:35.621 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 20 seconds' 2026-02-24T17:27:35.622 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 20 seconds 2026-02-24T17:27:35.622 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 20 -ge 5400 ']' 2026-02-24T17:27:35.622 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:27:35.623 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:27:35.743 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:35.739+0000 7fed2dec0640 -1 osd.9 150 handle_osd_map injecting map crc failure 2026-02-24T17:27:36.001 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:27:35.999+0000 7f8fc0cb1640 -1 osd.13 150 handle_osd_map injecting map crc failure 2026-02-24T17:27:36.002 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:27:35.993+0000 7f9b65176640 -1 osd.15 150 handle_osd_map injecting map crc failure 2026-02-24T17:27:36.569 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:27:36.567+0000 7ff66534f640 -1 osd.8 151 handle_osd_map injecting map crc failure 2026-02-24T17:27:36.569 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:27:36.568+0000 7fb6af2ac640 -1 osd.2 151 handle_osd_map injecting map crc failure 2026-02-24T17:27:37.449 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:27:37.445+0000 7fd22d90c640 -1 osd.11 151 handle_osd_map injecting map crc failure 2026-02-24T17:27:38.572 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:27:38.565+0000 7f9cfbed1640 -1 osd.3 153 handle_osd_map injecting map crc failure 2026-02-24T17:27:38.574 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:38.571+0000 7fed2dec0640 -1 osd.9 153 handle_osd_map injecting map crc failure 2026-02-24T17:27:39.574 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:27:39.572+0000 7f4dd23ca640 -1 osd.14 154 handle_osd_map injecting map crc failure 2026-02-24T17:27:41.228 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:41.227+0000 7fed2bebc640 -1 osd.9 155 handle_osd_map injecting map crc failure 2026-02-24T17:27:41.578 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:27:41.573+0000 7f9b6717a640 -1 osd.15 156 handle_osd_map injecting map crc failure 2026-02-24T17:27:43.081 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:27:43.077+0000 7f9cf9ecd640 -1 osd.3 157 handle_osd_map injecting map crc failure 2026-02-24T17:27:43.582 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:27:43.577+0000 7f09b1cb0640 -1 osd.7 158 handle_osd_map injecting map crc failure 2026-02-24T17:27:43.583 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:27:43.584+0000 7f4dd03c6640 -1 osd.14 158 handle_osd_map injecting map crc failure 2026-02-24T17:27:43.583 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:27:43.583+0000 7ff66334b640 -1 osd.8 158 handle_osd_map injecting map crc failure 2026-02-24T17:27:44.581 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:27:44.579+0000 7fbba8012640 -1 osd.12 159 handle_osd_map injecting map crc failure 2026-02-24T17:27:44.582 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:27:44.583+0000 7fbba8012640 -1 osd.12 159 handle_osd_map injecting map crc failure 2026-02-24T17:27:44.980 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:27:44.973+0000 7fd22b908640 -1 osd.11 159 handle_osd_map injecting map crc failure 2026-02-24T17:27:45.583 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:27:45.584+0000 7f4dd23ca640 -1 osd.14 160 handle_osd_map injecting map crc failure 2026-02-24T17:27:45.583 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:27:45.579+0000 7fb7ce2dd640 -1 osd.5 160 handle_osd_map injecting map crc failure 2026-02-24T17:27:45.623 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=30 2026-02-24T17:27:45.623 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 30 seconds 2026-02-24T17:27:45.624 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 30 seconds' 2026-02-24T17:27:45.624 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 30 -ge 5400 ']' 2026-02-24T17:27:45.624 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:27:45.624 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:27:46.585 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:27:46.583+0000 7ff66534f640 -1 osd.8 161 handle_osd_map injecting map crc failure 2026-02-24T17:27:46.586 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:27:46.584+0000 7fb6af2ac640 -1 osd.2 161 handle_osd_map injecting map crc failure 2026-02-24T17:27:47.589 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:27:47.585+0000 7f09b3cb4640 -1 osd.7 162 handle_osd_map injecting map crc failure 2026-02-24T17:27:48.589 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:48.587+0000 7fed2dec0640 -1 osd.9 163 handle_osd_map injecting map crc failure 2026-02-24T17:27:49.591 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:27:49.591+0000 7fb6ad2a8640 -1 osd.2 164 handle_osd_map injecting map crc failure 2026-02-24T17:27:50.590 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:50.591+0000 7fed2dec0640 -1 osd.9 165 handle_osd_map injecting map crc failure 2026-02-24T17:27:50.880 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:27:50.879+0000 7f1f4c0e3640 -1 osd.1 165 handle_osd_map injecting map crc failure 2026-02-24T17:27:52.041 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:27:52.039+0000 7f1f4c0e3640 -1 osd.1 166 handle_osd_map injecting map crc failure 2026-02-24T17:27:52.042 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:27:52.039+0000 7f5984aae640 -1 osd.0 166 handle_osd_map injecting map crc failure 2026-02-24T17:27:52.042 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:27:52.039+0000 7ff66334b640 -1 osd.8 166 handle_osd_map injecting map crc failure 2026-02-24T17:27:52.427 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:27:52.427+0000 7fce6334b640 -1 osd.6 166 handle_osd_map injecting map crc failure 2026-02-24T17:27:52.596 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:27:52.589+0000 7fd22b908640 -1 osd.11 167 handle_osd_map injecting map crc failure 2026-02-24T17:27:53.596 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:53.595+0000 7fed2dec0640 -1 osd.9 168 handle_osd_map injecting map crc failure 2026-02-24T17:27:53.682 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:27:53.683+0000 7f1f4c0e3640 -1 osd.1 168 handle_osd_map injecting map crc failure 2026-02-24T17:27:54.599 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:27:54.595+0000 7fb7cc2d9640 -1 osd.5 169 handle_osd_map injecting map crc failure 2026-02-24T17:27:54.601 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:27:54.599+0000 7f1f4c0e3640 -1 osd.1 169 handle_osd_map injecting map crc failure 2026-02-24T17:27:55.599 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:27:55.595+0000 7fed2dec0640 -1 osd.9 170 handle_osd_map injecting map crc failure 2026-02-24T17:27:55.623 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=40 2026-02-24T17:27:55.624 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 40 seconds' 2026-02-24T17:27:55.624 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 40 seconds 2026-02-24T17:27:55.624 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 40 -ge 5400 ']' 2026-02-24T17:27:55.625 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:27:55.625 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:27:56.599 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:27:56.599+0000 7ff66534f640 -1 osd.8 171 handle_osd_map injecting map crc failure 2026-02-24T17:27:58.607 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:27:58.602+0000 7f1f4c0e3640 -1 osd.1 173 handle_osd_map injecting map crc failure 2026-02-24T17:27:59.608 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:27:59.601+0000 7f09b3cb4640 -1 osd.7 174 handle_osd_map injecting map crc failure 2026-02-24T17:27:59.608 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:27:59.607+0000 7f4dd23ca640 -1 osd.14 174 handle_osd_map injecting map crc failure 2026-02-24T17:28:00.612 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:00.606+0000 7fb7ce2dd640 -1 osd.5 175 handle_osd_map injecting map crc failure 2026-02-24T17:28:00.612 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:28:00.611+0000 7fb6af2ac640 -1 osd.2 175 handle_osd_map injecting map crc failure 2026-02-24T17:28:01.614 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:28:01.611+0000 7fb6af2ac640 -1 osd.2 176 handle_osd_map injecting map crc failure 2026-02-24T17:28:04.626 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:28:04.623+0000 7f4dd23ca640 -1 osd.14 179 handle_osd_map injecting map crc failure 2026-02-24T17:28:05.625 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=50 2026-02-24T17:28:05.625 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 50 seconds' 2026-02-24T17:28:05.625 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 50 seconds 2026-02-24T17:28:05.626 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 50 -ge 5400 ']' 2026-02-24T17:28:05.626 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:28:05.626 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:28:05.629 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:28:05.625+0000 7f9b6717a640 -1 osd.15 180 handle_osd_map injecting map crc failure 2026-02-24T17:28:05.630 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:28:05.626+0000 7fed2dec0640 -1 osd.9 180 handle_osd_map injecting map crc failure 2026-02-24T17:28:05.683 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:28:05.683+0000 7ff66334b640 -1 osd.8 180 handle_osd_map injecting map crc failure 2026-02-24T17:28:05.914 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:05.914+0000 7fb7ce2dd640 -1 osd.5 180 handle_osd_map injecting map crc failure 2026-02-24T17:28:07.632 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:07.631+0000 7f72dede7640 -1 osd.10 181 handle_osd_map injecting map crc failure 2026-02-24T17:28:07.635 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:28:07.635+0000 7fb6ad2a8640 -1 osd.2 181 handle_osd_map injecting map crc failure 2026-02-24T17:28:07.635 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:07.630+0000 7fb7cc2d9640 -1 osd.5 181 handle_osd_map injecting map crc failure 2026-02-24T17:28:07.635 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:28:07.630+0000 7f1f4c0e3640 -1 osd.1 182 handle_osd_map injecting map crc failure 2026-02-24T17:28:07.635 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:28:07.629+0000 7f09b1cb0640 -1 osd.7 181 handle_osd_map injecting map crc failure 2026-02-24T17:28:07.842 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:28:07.837+0000 7f9b65176640 -1 osd.15 181 handle_osd_map injecting map crc failure 2026-02-24T17:28:08.633 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:28:08.631+0000 7ff66534f640 -1 osd.8 183 handle_osd_map injecting map crc failure 2026-02-24T17:28:09.686 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:28:09.687+0000 7fbba8012640 -1 osd.12 184 handle_osd_map injecting map crc failure 2026-02-24T17:28:09.729 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:28:09.725+0000 7f9b6717a640 -1 osd.15 184 handle_osd_map injecting map crc failure 2026-02-24T17:28:09.735 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:28:09.735+0000 7f4dd23ca640 -1 osd.14 184 handle_osd_map injecting map crc failure 2026-02-24T17:28:11.639 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:11.639+0000 7f72dede7640 -1 osd.10 186 handle_osd_map injecting map crc failure 2026-02-24T17:28:11.639 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:28:11.639+0000 7fce6334b640 -1 osd.6 186 handle_osd_map injecting map crc failure 2026-02-24T17:28:13.492 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:28:13.490+0000 7fe8108d8640 -1 osd.4 187 handle_osd_map injecting map crc failure 2026-02-24T17:28:14.003 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:14.002+0000 7fb7cc2d9640 -1 osd.5 188 handle_osd_map injecting map crc failure 2026-02-24T17:28:14.003 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:14.002+0000 7fb7cc2d9640 -1 osd.5 188 handle_osd_map injecting map crc failure 2026-02-24T17:28:14.695 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:28:14.694+0000 7f5984aae640 -1 osd.0 188 handle_osd_map injecting map crc failure 2026-02-24T17:28:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=60 2026-02-24T17:28:15.626 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 60 seconds' 2026-02-24T17:28:15.627 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 60 seconds 2026-02-24T17:28:15.627 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 60 -ge 5400 ']' 2026-02-24T17:28:15.627 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:28:15.628 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:28:15.804 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:28:15.802+0000 7fe8108d8640 -1 osd.4 189 handle_osd_map injecting map crc failure 2026-02-24T17:28:16.646 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:28:16.642+0000 7fed2bebc640 -1 osd.9 191 handle_osd_map injecting map crc failure 2026-02-24T17:28:17.646 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:17.646+0000 7fb7ce2dd640 -1 osd.5 192 handle_osd_map injecting map crc failure 2026-02-24T17:28:19.696 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:19.695+0000 7f72dcde3640 -1 osd.10 194 handle_osd_map injecting map crc failure 2026-02-24T17:28:19.743 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:28:19.743+0000 7fb6af2ac640 -1 osd.2 193 handle_osd_map injecting map crc failure 2026-02-24T17:28:20.649 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:28:20.648+0000 7f09b3cb4640 -1 osd.7 195 handle_osd_map injecting map crc failure 2026-02-24T17:28:20.649 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:20.650+0000 7f8fc2cb5640 -1 osd.13 195 handle_osd_map injecting map crc failure 2026-02-24T17:28:20.649 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:20.650+0000 7fb7ce2dd640 -1 osd.5 195 handle_osd_map injecting map crc failure 2026-02-24T17:28:21.819 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:21.819+0000 7f72dcde3640 -1 osd.10 196 handle_osd_map injecting map crc failure 2026-02-24T17:28:22.024 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:28:22.026+0000 7fed2bebc640 -1 osd.9 196 handle_osd_map injecting map crc failure 2026-02-24T17:28:22.654 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:28:22.650+0000 7fe8128dc640 -1 osd.4 197 handle_osd_map injecting map crc failure 2026-02-24T17:28:23.653 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:28:23.650+0000 7ff66534f640 -1 osd.8 198 handle_osd_map injecting map crc failure 2026-02-24T17:28:23.654 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:28:23.648+0000 7f9cfbed1640 -1 osd.3 198 handle_osd_map injecting map crc failure 2026-02-24T17:28:23.704 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:23.706+0000 7fb7cc2d9640 -1 osd.5 198 handle_osd_map injecting map crc failure 2026-02-24T17:28:24.655 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:28:24.655+0000 7fce6334b640 -1 osd.6 199 handle_osd_map injecting map crc failure 2026-02-24T17:28:25.027 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:28:25.026+0000 7fed2bebc640 -1 osd.9 199 handle_osd_map injecting map crc failure 2026-02-24T17:28:25.027 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:28:25.020+0000 7f9b65176640 -1 osd.15 199 handle_osd_map injecting map crc failure 2026-02-24T17:28:25.028 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:28:25.026+0000 7ff66334b640 -1 osd.8 199 handle_osd_map injecting map crc failure 2026-02-24T17:28:25.384 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:28:25.382+0000 7fe8108d8640 -1 osd.4 199 handle_osd_map injecting map crc failure 2026-02-24T17:28:25.628 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=70 2026-02-24T17:28:25.628 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 70 seconds 2026-02-24T17:28:25.629 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 70 seconds' 2026-02-24T17:28:25.629 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 70 -ge 5400 ']' 2026-02-24T17:28:25.629 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:28:25.629 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:28:25.656 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:25.658+0000 7f8fc2cb5640 -1 osd.13 200 handle_osd_map injecting map crc failure 2026-02-24T17:28:25.692 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:25.691+0000 7f72dcde3640 -1 osd.10 199 handle_osd_map injecting map crc failure 2026-02-24T17:28:28.105 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:28:28.106+0000 7f1f4c0e3640 -1 osd.1 202 handle_osd_map injecting map crc failure 2026-02-24T17:28:28.107 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:28:28.100+0000 7f9cf9ecd640 -1 osd.3 202 handle_osd_map injecting map crc failure 2026-02-24T17:28:28.404 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:28:28.402+0000 7fce61347640 -1 osd.6 202 handle_osd_map injecting map crc failure 2026-02-24T17:28:28.660 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:28:28.658+0000 7fbba8012640 -1 osd.12 203 handle_osd_map injecting map crc failure 2026-02-24T17:28:28.732 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:28:28.728+0000 7f9cf9ecd640 -1 osd.3 203 handle_osd_map injecting map crc failure 2026-02-24T17:28:29.665 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:29.666+0000 7f8fc2cb5640 -1 osd.13 204 handle_osd_map injecting map crc failure 2026-02-24T17:28:30.669 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:30.670+0000 7f8fc2cb5640 -1 osd.13 205 handle_osd_map injecting map crc failure 2026-02-24T17:28:30.670 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:28:30.664+0000 7f9b6717a640 -1 osd.15 205 handle_osd_map injecting map crc failure 2026-02-24T17:28:32.006 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:28:32.000+0000 7f9cf9ecd640 -1 osd.3 206 handle_osd_map injecting map crc failure 2026-02-24T17:28:32.244 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:28:32.246+0000 7f5984aae640 -1 osd.0 206 handle_osd_map injecting map crc failure 2026-02-24T17:28:32.306 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:28:32.302+0000 7fb6ad2a8640 -1 osd.2 206 handle_osd_map injecting map crc failure 2026-02-24T17:28:33.681 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:33.682+0000 7f8fc2cb5640 -1 osd.13 208 handle_osd_map injecting map crc failure 2026-02-24T17:28:34.687 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:34.686+0000 7f8fc0cb1640 -1 osd.13 209 handle_osd_map injecting map crc failure 2026-02-24T17:28:35.629 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=80 2026-02-24T17:28:35.630 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 80 seconds 2026-02-24T17:28:35.631 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 80 seconds' 2026-02-24T17:28:35.631 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 80 -ge 5400 ']' 2026-02-24T17:28:35.631 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:28:35.631 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:28:35.688 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:28:35.680+0000 7fd22d90c640 -1 osd.11 210 handle_osd_map injecting map crc failure 2026-02-24T17:28:37.084 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:28:37.080+0000 7f9cf9ecd640 -1 osd.3 211 handle_osd_map injecting map crc failure 2026-02-24T17:28:37.085 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:28:37.085+0000 7fed2bebc640 -1 osd.9 211 handle_osd_map injecting map crc failure 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout:_aio: [ OK ] LibRadosAio.CancelBeforeComplete (3010 ms) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (3015 ms) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [----------] 29 tests from LibRadosAio (86017 ms total) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (5963 ms) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6014 ms) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6007 ms) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6016 ms) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6007 ms) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6029 ms) 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-24T17:28:37.704 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6006 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6007 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6013 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6013 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6019 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6005 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6008 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (6007 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (6015 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6024 ms) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (96161 ms total) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [----------] Global test environment tear-down 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (182178 ms total) 2026-02-24T17:28:37.705 INFO:tasks.workunit.client.0.trial120.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-24T17:28:38.727 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:28:38.725+0000 7f1f4c0e3640 -1 osd.1 213 handle_osd_map injecting map crc failure 2026-02-24T17:28:38.727 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:38.725+0000 7fb7cc2d9640 -1 osd.5 213 handle_osd_map injecting map crc failure 2026-02-24T17:28:40.707 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:40.705+0000 7fb7ce2dd640 -1 osd.5 215 handle_osd_map injecting map crc failure 2026-02-24T17:28:40.707 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:28:40.704+0000 7fd22d90c640 -1 osd.11 215 handle_osd_map injecting map crc failure 2026-02-24T17:28:40.708 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:40.706+0000 7f72dede7640 -1 osd.10 215 handle_osd_map injecting map crc failure 2026-02-24T17:28:41.708 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:41.709+0000 7f8fc2cb5640 -1 osd.13 216 handle_osd_map injecting map crc failure 2026-02-24T17:28:42.684 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:28:42.676+0000 7fd22b908640 -1 osd.11 216 handle_osd_map injecting map crc failure 2026-02-24T17:28:42.928 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:28:42.929+0000 7f1f4c0e3640 -1 osd.1 216 handle_osd_map injecting map crc failure 2026-02-24T17:28:42.929 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:28:42.926+0000 7fb6ad2a8640 -1 osd.2 217 handle_osd_map injecting map crc failure 2026-02-24T17:28:43.834 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:43.833+0000 7f8fc0cb1640 -1 osd.13 218 handle_osd_map injecting map crc failure 2026-02-24T17:28:44.723 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:28:44.721+0000 7f1f4e0e7640 -1 osd.1 219 handle_osd_map injecting map crc failure 2026-02-24T17:28:44.723 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:44.721+0000 7fb7ce2dd640 -1 osd.5 219 handle_osd_map injecting map crc failure 2026-02-24T17:28:44.723 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:28:44.722+0000 7f4dd23ca640 -1 osd.14 219 handle_osd_map injecting map crc failure 2026-02-24T17:28:44.725 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:44.722+0000 7f72dede7640 -1 osd.10 219 handle_osd_map injecting map crc failure 2026-02-24T17:28:45.631 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=90 2026-02-24T17:28:45.631 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 90 seconds 2026-02-24T17:28:45.632 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 90 seconds' 2026-02-24T17:28:45.632 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 90 -ge 5400 ']' 2026-02-24T17:28:45.632 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:28:45.632 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:28:46.226 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:28:46.222+0000 7f5984aae640 -1 osd.0 220 handle_osd_map injecting map crc failure 2026-02-24T17:28:46.730 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:28:46.726+0000 7fbba8012640 -1 osd.12 221 handle_osd_map injecting map crc failure 2026-02-24T17:28:47.098 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:28:47.096+0000 7f09b1cb0640 -1 osd.7 221 handle_osd_map injecting map crc failure 2026-02-24T17:28:48.045 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:28:48.044+0000 7f09b1cb0640 -1 osd.7 222 handle_osd_map injecting map crc failure 2026-02-24T17:28:48.229 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:28:48.230+0000 7fbba600e640 -1 osd.12 222 handle_osd_map injecting map crc failure 2026-02-24T17:28:48.229 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:48.226+0000 7f72dcde3640 -1 osd.10 222 handle_osd_map injecting map crc failure 2026-02-24T17:28:48.861 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:28:48.858+0000 7ff66334b640 -1 osd.8 223 handle_osd_map injecting map crc failure 2026-02-24T17:28:49.007 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:28:49.005+0000 7f8fc0cb1640 -1 osd.13 223 handle_osd_map injecting map crc failure 2026-02-24T17:28:49.748 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:28:49.746+0000 7f5986ab2640 -1 osd.0 224 handle_osd_map injecting map crc failure 2026-02-24T17:28:49.757 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:28:49.756+0000 7f9b6717a640 -1 osd.15 224 handle_osd_map injecting map crc failure 2026-02-24T17:28:50.754 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:28:50.753+0000 7fed2dec0640 -1 osd.9 225 handle_osd_map injecting map crc failure 2026-02-24T17:28:50.755 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:28:50.750+0000 7fb6af2ac640 -1 osd.2 225 handle_osd_map injecting map crc failure 2026-02-24T17:28:52.308 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:28:52.306+0000 7f72dcde3640 -1 osd.10 226 handle_osd_map injecting map crc failure 2026-02-24T17:28:54.765 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:28:54.762+0000 7fce61347640 -1 osd.6 228 handle_osd_map injecting map crc failure 2026-02-24T17:28:55.030 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:28:55.026+0000 7f4dd03c6640 -1 osd.14 229 handle_osd_map injecting map crc failure 2026-02-24T17:28:55.632 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=100 2026-02-24T17:28:55.632 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 100 seconds' 2026-02-24T17:28:55.632 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 100 seconds 2026-02-24T17:28:55.632 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 100 -ge 5400 ']' 2026-02-24T17:28:55.632 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:28:55.632 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:28:55.763 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:28:55.762+0000 7fbba8012640 -1 osd.12 230 handle_osd_map injecting map crc failure 2026-02-24T17:28:59.786 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:28:59.782+0000 7ff66534f640 -1 osd.8 234 handle_osd_map injecting map crc failure 2026-02-24T17:28:59.786 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:28:59.784+0000 7f9cfbed1640 -1 osd.3 234 handle_osd_map injecting map crc failure 2026-02-24T17:28:59.786 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:28:59.785+0000 7fb7ce2dd640 -1 osd.5 234 handle_osd_map injecting map crc failure 2026-02-24T17:29:00.793 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:29:00.790+0000 7f5984aae640 -1 osd.0 235 handle_osd_map injecting map crc failure 2026-02-24T17:29:00.794 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:29:00.793+0000 7f8fc0cb1640 -1 osd.13 235 handle_osd_map injecting map crc failure 2026-02-24T17:29:01.792 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:29:01.790+0000 7ff66534f640 -1 osd.8 236 handle_osd_map injecting map crc failure 2026-02-24T17:29:01.793 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:01.788+0000 7f9b6717a640 -1 osd.15 236 handle_osd_map injecting map crc failure 2026-02-24T17:29:01.794 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:29:01.793+0000 7fb7ce2dd640 -1 osd.5 236 handle_osd_map injecting map crc failure 2026-02-24T17:29:02.130 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:02.130+0000 7f4dd03c6640 -1 osd.14 236 handle_osd_map injecting map crc failure 2026-02-24T17:29:02.211 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:02.209+0000 7f1f4c0e3640 -1 osd.1 236 handle_osd_map injecting map crc failure 2026-02-24T17:29:03.801 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:03.798+0000 7f4dd23ca640 -1 osd.14 237 handle_osd_map injecting map crc failure 2026-02-24T17:29:03.908 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:03.909+0000 7f1f4c0e3640 -1 osd.1 237 handle_osd_map injecting map crc failure 2026-02-24T17:29:04.108 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:29:04.104+0000 7f9cf9ecd640 -1 osd.3 238 handle_osd_map injecting map crc failure 2026-02-24T17:29:04.804 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:29:04.805+0000 7f8fc2cb5640 -1 osd.13 239 handle_osd_map injecting map crc failure 2026-02-24T17:29:05.208 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:29:05.208+0000 7fd22b908640 -1 osd.11 239 handle_osd_map injecting map crc failure 2026-02-24T17:29:05.634 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=110 2026-02-24T17:29:05.634 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 110 seconds' 2026-02-24T17:29:05.634 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 110 seconds 2026-02-24T17:29:05.635 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 110 -ge 5400 ']' 2026-02-24T17:29:05.635 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:29:05.635 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:29:05.805 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:29:05.806+0000 7ff66534f640 -1 osd.8 240 handle_osd_map injecting map crc failure 2026-02-24T17:29:06.289 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:29:06.286+0000 7f72dcde3640 -1 osd.10 239 handle_osd_map injecting map crc failure 2026-02-24T17:29:09.827 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:29:09.824+0000 7fd22d90c640 -1 osd.11 244 handle_osd_map injecting map crc failure 2026-02-24T17:29:11.637 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:29:11.634+0000 7fe8108d8640 -1 osd.4 245 handle_osd_map injecting map crc failure 2026-02-24T17:29:12.328 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:29:12.330+0000 7f5984aae640 -1 osd.0 246 handle_osd_map injecting map crc failure 2026-02-24T17:29:12.496 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:29:12.493+0000 7f72dcde3640 -1 osd.10 246 handle_osd_map injecting map crc failure 2026-02-24T17:29:12.496 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:29:12.493+0000 7f72dcde3640 -1 osd.10 246 handle_osd_map injecting map crc failure 2026-02-24T17:29:13.047 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:13.045+0000 7f4dd03c6640 -1 osd.14 246 handle_osd_map injecting map crc failure 2026-02-24T17:29:13.231 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:13.228+0000 7f9b65176640 -1 osd.15 246 handle_osd_map injecting map crc failure 2026-02-24T17:29:13.837 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:29:13.838+0000 7fe8128dc640 -1 osd.4 248 handle_osd_map injecting map crc failure 2026-02-24T17:29:14.109 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:29:14.108+0000 7f09b1cb0640 -1 osd.7 248 handle_osd_map injecting map crc failure 2026-02-24T17:29:14.840 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:29:14.837+0000 7fb6af2ac640 -1 osd.2 249 handle_osd_map injecting map crc failure 2026-02-24T17:29:14.990 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:29:14.985+0000 7fce61347640 -1 osd.6 249 handle_osd_map injecting map crc failure 2026-02-24T17:29:15.635 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=120 2026-02-24T17:29:15.635 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 120 seconds' 2026-02-24T17:29:15.635 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 120 seconds 2026-02-24T17:29:15.635 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 120 -ge 5400 ']' 2026-02-24T17:29:15.635 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:29:15.635 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:29:18.863 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:29:18.861+0000 7fb7cc2d9640 -1 osd.5 253 handle_osd_map injecting map crc failure 2026-02-24T17:29:18.970 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:29:18.969+0000 7fed2dec0640 -1 osd.9 253 handle_osd_map injecting map crc failure 2026-02-24T17:29:19.863 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:19.861+0000 7f1f4e0e7640 -1 osd.1 254 handle_osd_map injecting map crc failure 2026-02-24T17:29:19.863 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:29:19.861+0000 7f8fc2cb5640 -1 osd.13 254 handle_osd_map injecting map crc failure 2026-02-24T17:29:21.297 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:29:21.293+0000 7fce61347640 -1 osd.6 255 handle_osd_map injecting map crc failure 2026-02-24T17:29:22.589 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:29:22.588+0000 7f9cf9ecd640 -1 osd.3 256 handle_osd_map injecting map crc failure 2026-02-24T17:29:24.449 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:29:24.448+0000 7f9cf9ecd640 -1 osd.3 257 handle_osd_map injecting map crc failure 2026-02-24T17:29:24.501 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:29:24.497+0000 7fce61347640 -1 osd.6 258 handle_osd_map injecting map crc failure 2026-02-24T17:29:24.502 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:29:24.497+0000 7fce61347640 -1 osd.6 258 handle_osd_map injecting map crc failure 2026-02-24T17:29:24.797 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:24.793+0000 7f4dd03c6640 -1 osd.14 258 handle_osd_map injecting map crc failure 2026-02-24T17:29:24.872 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:24.872+0000 7f9b6717a640 -1 osd.15 259 handle_osd_map injecting map crc failure 2026-02-24T17:29:24.912 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:29:24.909+0000 7fb6ad2a8640 -1 osd.2 258 handle_osd_map injecting map crc failure 2026-02-24T17:29:25.636 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=130 2026-02-24T17:29:25.637 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 130 seconds' 2026-02-24T17:29:25.637 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 130 seconds 2026-02-24T17:29:25.637 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 130 -ge 5400 ']' 2026-02-24T17:29:25.637 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:29:25.638 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:29:26.104 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:29:26.105+0000 7fed2dec0640 -1 osd.9 260 handle_osd_map injecting map crc failure 2026-02-24T17:29:28.401 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:29:28.400+0000 7f09b1cb0640 -1 osd.7 261 handle_osd_map injecting map crc failure 2026-02-24T17:29:28.402 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:28.400+0000 7f9b65176640 -1 osd.15 261 handle_osd_map injecting map crc failure 2026-02-24T17:29:29.129 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:29:29.126+0000 7f5984aae640 -1 osd.0 263 handle_osd_map injecting map crc failure 2026-02-24T17:29:29.148 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:29:29.148+0000 7f09b1cb0640 -1 osd.7 263 handle_osd_map injecting map crc failure 2026-02-24T17:29:30.112 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:29:30.110+0000 7fbba8012640 -1 osd.12 264 handle_osd_map injecting map crc failure 2026-02-24T17:29:30.112 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:29:30.109+0000 7f72dede7640 -1 osd.10 264 handle_osd_map injecting map crc failure 2026-02-24T17:29:30.112 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:29:30.113+0000 7fb7ce2dd640 -1 osd.5 264 handle_osd_map injecting map crc failure 2026-02-24T17:29:30.210 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:29:30.205+0000 7fb6ad2a8640 -1 osd.2 264 handle_osd_map injecting map crc failure 2026-02-24T17:29:31.176 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:31.177+0000 7f1f4e0e7640 -1 osd.1 265 handle_osd_map injecting map crc failure 2026-02-24T17:29:31.311 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:29:31.307+0000 7f9cf9ecd640 -1 osd.3 265 handle_osd_map injecting map crc failure 2026-02-24T17:29:31.311 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:31.309+0000 7f4dd03c6640 -1 osd.14 265 handle_osd_map injecting map crc failure 2026-02-24T17:29:33.116 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:29:33.117+0000 7f8fc2cb5640 -1 osd.13 267 handle_osd_map injecting map crc failure 2026-02-24T17:29:34.014 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:34.011+0000 7f9b65176640 -1 osd.15 267 handle_osd_map injecting map crc failure 2026-02-24T17:29:34.117 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:29:34.117+0000 7fed2dec0640 -1 osd.9 267 handle_osd_map injecting map crc failure 2026-02-24T17:29:34.118 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:29:34.115+0000 7f09b3cb4640 -1 osd.7 267 handle_osd_map injecting map crc failure 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout:.RoundTripAppendPP (2992 ms) 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3013 ms) 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3001 ms) 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3010 ms) 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: sending pool EIO time: 2026-02-24T17:27:34.569113+0000 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: ./src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-24T17:29:34.121 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (9024 ms) 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3014 ms) 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (124066 ms total) 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (2993 ms) 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9021 ms) 2026-02-24T17:29:34.122 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15031 ms) 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3013 ms) 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30059 ms total) 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (2995 ms) 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (2995 ms total) 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-24T17:29:34.123 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (12016 ms) 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6015 ms) 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6023 ms) 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (6013 ms) 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3017 ms) 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6031 ms) 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6008 ms) 2026-02-24T17:29:34.124 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6034 ms) 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (6026 ms) 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (6013 ms) 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6025 ms) 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (6242 ms) 2026-02-24T17:29:34.125 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-24T17:29:34.449 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:29:34.446+0000 7ff66334b640 -1 osd.8 268 handle_osd_map injecting map crc failure 2026-02-24T17:29:34.450 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:29:34.449+0000 7f8fc0cb1640 -1 osd.13 268 handle_osd_map injecting map crc failure 2026-02-24T17:29:34.910 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:29:34.907+0000 7f9cf9ecd640 -1 osd.3 268 handle_osd_map injecting map crc failure 2026-02-24T17:29:35.166 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:29:35.166+0000 7fbba600e640 -1 osd.12 269 handle_osd_map injecting map crc failure 2026-02-24T17:29:35.638 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=140 2026-02-24T17:29:35.638 INFO:tasks.workunit.client.0.trial120.stdout: Waiting for test api_aio_pp (PID 20233)... waited 140 seconds 2026-02-24T17:29:35.639 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 140 seconds' 2026-02-24T17:29:35.639 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 140 -ge 5400 ']' 2026-02-24T17:29:35.639 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:29:35.639 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:29:36.140 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:36.137+0000 7f4dd23ca640 -1 osd.14 270 handle_osd_map injecting map crc failure 2026-02-24T17:29:37.791 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:29:37.789+0000 7f72dcde3640 -1 osd.10 271 handle_osd_map injecting map crc failure 2026-02-24T17:29:38.901 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:29:38.901+0000 7fed2bebc640 -1 osd.9 272 handle_osd_map injecting map crc failure 2026-02-24T17:29:39.130 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:39.129+0000 7f1f4c0e3640 -1 osd.1 272 handle_osd_map injecting map crc failure 2026-02-24T17:29:39.510 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:29:39.509+0000 7fb6ad2a8640 -1 osd.2 272 handle_osd_map injecting map crc failure 2026-02-24T17:29:39.511 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:29:39.510+0000 7ff66334b640 -1 osd.8 272 handle_osd_map injecting map crc failure 2026-02-24T17:29:39.532 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:29:39.533+0000 7fed2bebc640 -1 osd.9 273 handle_osd_map injecting map crc failure 2026-02-24T17:29:40.154 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:29:40.154+0000 7f5986ab2640 -1 osd.0 274 handle_osd_map injecting map crc failure 2026-02-24T17:29:40.155 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:29:40.154+0000 7fe8128dc640 -1 osd.4 274 handle_osd_map injecting map crc failure 2026-02-24T17:29:40.156 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:29:40.151+0000 7f9cfbed1640 -1 osd.3 274 handle_osd_map injecting map crc failure 2026-02-24T17:29:40.156 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:40.151+0000 7f9b6717a640 -1 osd.15 274 handle_osd_map injecting map crc failure 2026-02-24T17:29:41.157 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:41.157+0000 7f1f4e0e7640 -1 osd.1 275 handle_osd_map injecting map crc failure 2026-02-24T17:29:41.157 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:29:41.155+0000 7fd22d90c640 -1 osd.11 275 handle_osd_map injecting map crc failure 2026-02-24T17:29:41.891 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:29:41.890+0000 7ff66334b640 -1 osd.8 275 handle_osd_map injecting map crc failure 2026-02-24T17:29:43.158 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:29:43.153+0000 7fce6334b640 -1 osd.6 276 handle_osd_map injecting map crc failure 2026-02-24T17:29:43.498 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:29:43.498+0000 7f5984aae640 -1 osd.0 276 handle_osd_map injecting map crc failure 2026-02-24T17:29:44.176 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:29:44.174+0000 7ff66534f640 -1 osd.8 277 handle_osd_map injecting map crc failure 2026-02-24T17:29:45.302 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:29:45.299+0000 7fd22b908640 -1 osd.11 279 handle_osd_map injecting map crc failure 2026-02-24T17:29:45.550 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:29:45.547+0000 7f09b1cb0640 -1 osd.7 279 handle_osd_map injecting map crc failure 2026-02-24T17:29:45.640 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=150 2026-02-24T17:29:45.640 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 150 seconds 2026-02-24T17:29:45.641 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 150 seconds' 2026-02-24T17:29:45.641 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 150 -ge 5400 ']' 2026-02-24T17:29:45.641 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:29:45.641 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:29:46.218 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:29:46.217+0000 7fb7cc2d9640 -1 osd.5 280 handle_osd_map injecting map crc failure 2026-02-24T17:29:47.230 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:47.227+0000 7f9b65176640 -1 osd.15 281 handle_osd_map injecting map crc failure 2026-02-24T17:29:48.191 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:29:48.189+0000 7f72dede7640 -1 osd.10 282 handle_osd_map injecting map crc failure 2026-02-24T17:29:51.040 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:51.035+0000 7f9b65176640 -1 osd.15 284 handle_osd_map injecting map crc failure 2026-02-24T17:29:51.392 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:51.393+0000 7f1f4c0e3640 -1 osd.1 284 handle_osd_map injecting map crc failure 2026-02-24T17:29:51.602 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:29:51.602+0000 7f5984aae640 -1 osd.0 284 handle_osd_map injecting map crc failure 2026-02-24T17:29:51.603 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:51.596+0000 7f4dd03c6640 -1 osd.14 285 handle_osd_map injecting map crc failure 2026-02-24T17:29:51.604 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:29:51.602+0000 7f5986ab2640 -1 osd.0 285 handle_osd_map injecting map crc failure 2026-02-24T17:29:52.133 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:29:52.131+0000 7f9b65176640 -1 osd.15 285 handle_osd_map injecting map crc failure 2026-02-24T17:29:52.205 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:52.205+0000 7f1f4e0e7640 -1 osd.1 286 handle_osd_map injecting map crc failure 2026-02-24T17:29:52.206 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:52.204+0000 7f4dd23ca640 -1 osd.14 286 handle_osd_map injecting map crc failure 2026-02-24T17:29:53.208 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:29:53.206+0000 7fe8128dc640 -1 osd.4 287 handle_osd_map injecting map crc failure 2026-02-24T17:29:53.209 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:29:53.204+0000 7fb6af2ac640 -1 osd.2 287 handle_osd_map injecting map crc failure 2026-02-24T17:29:55.216 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:29:55.217+0000 7f1f4e0e7640 -1 osd.1 288 handle_osd_map injecting map crc failure 2026-02-24T17:29:55.641 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=160 2026-02-24T17:29:55.642 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 160 seconds' 2026-02-24T17:29:55.642 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 160 seconds 2026-02-24T17:29:55.643 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 160 -ge 5400 ']' 2026-02-24T17:29:55.643 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:29:55.643 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:29:56.203 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:29:56.200+0000 7f72dcde3640 -1 osd.10 289 handle_osd_map injecting map crc failure 2026-02-24T17:29:56.220 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:29:56.218+0000 7fbba8012640 -1 osd.12 290 handle_osd_map injecting map crc failure 2026-02-24T17:29:57.191 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:29:57.187+0000 7fd22b908640 -1 osd.11 290 handle_osd_map injecting map crc failure 2026-02-24T17:29:57.192 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:29:57.187+0000 7fd22b908640 -1 osd.11 290 handle_osd_map injecting map crc failure 2026-02-24T17:29:57.634 INFO:tasks.ceph.osd.14.trial109.stderr:2026-02-24T17:29:57.632+0000 7f4dd03c6640 -1 osd.14 290 handle_osd_map injecting map crc failure 2026-02-24T17:29:57.634 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:29:57.634+0000 7ff66334b640 -1 osd.8 291 handle_osd_map injecting map crc failure 2026-02-24T17:29:58.348 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:29:58.347+0000 7f9cf9ecd640 -1 osd.3 292 handle_osd_map injecting map crc failure 2026-02-24T17:29:59.224 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:29:59.225+0000 7fed2dec0640 -1 osd.9 293 handle_osd_map injecting map crc failure 2026-02-24T17:29:59.225 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-24T17:29:59.226+0000 7f5986ab2640 -1 osd.0 293 handle_osd_map injecting map crc failure 2026-02-24T17:30:00.226 INFO:tasks.ceph.osd.13.trial094.stderr:2026-02-24T17:30:00.225+0000 7f8fc2cb5640 -1 osd.13 294 handle_osd_map injecting map crc failure 2026-02-24T17:30:01.227 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:30:01.224+0000 7fb6af2ac640 -1 osd.2 295 handle_osd_map injecting map crc failure 2026-02-24T17:30:01.493 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:30:01.493+0000 7fb7cc2d9640 -1 osd.5 295 handle_osd_map injecting map crc failure 2026-02-24T17:30:01.493 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:30:01.491+0000 7fd22b908640 -1 osd.11 295 handle_osd_map injecting map crc failure 2026-02-24T17:30:02.141 INFO:tasks.ceph.osd.15.trial120.stderr:2026-02-24T17:30:02.139+0000 7f9b65176640 -1 osd.15 295 handle_osd_map injecting map crc failure 2026-02-24T17:30:02.517 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:30:02.512+0000 7fb6ad2a8640 -1 osd.2 296 handle_osd_map injecting map crc failure 2026-02-24T17:30:03.244 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:30:03.240+0000 7f72dede7640 -1 osd.10 296 handle_osd_map injecting map crc failure 2026-02-24T17:30:03.834 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:30:03.831+0000 7fd22b908640 -1 osd.11 296 handle_osd_map injecting map crc failure 2026-02-24T17:30:04.104 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:30:04.103+0000 7f09b1cb0640 -1 osd.7 296 handle_osd_map injecting map crc failure 2026-02-24T17:30:04.246 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:30:04.246+0000 7fe8128dc640 -1 osd.4 298 handle_osd_map injecting map crc failure 2026-02-24T17:30:04.247 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:30:04.244+0000 7f72dede7640 -1 osd.10 298 handle_osd_map injecting map crc failure 2026-02-24T17:30:04.293 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:30:04.292+0000 7f1f4c0e3640 -1 osd.1 298 handle_osd_map injecting map crc failure 2026-02-24T17:30:05.262 INFO:tasks.ceph.osd.12.trial040.stderr:2026-02-24T17:30:05.262+0000 7fbba8012640 -1 osd.12 299 handle_osd_map injecting map crc failure 2026-02-24T17:30:05.643 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=170 2026-02-24T17:30:05.643 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 170 seconds 2026-02-24T17:30:05.644 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 170 seconds' 2026-02-24T17:30:05.644 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 170 -ge 5400 ']' 2026-02-24T17:30:05.644 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:30:05.644 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:30:06.313 INFO:tasks.ceph.osd.5.trial094.stderr:2026-02-24T17:30:06.312+0000 7fb7cc2d9640 -1 osd.5 300 handle_osd_map injecting map crc failure 2026-02-24T17:30:08.434 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:30:08.434+0000 7fe8108d8640 -1 osd.4 300 handle_osd_map injecting map crc failure 2026-02-24T17:30:08.812 INFO:tasks.ceph.osd.1.trial094.stderr:2026-02-24T17:30:08.812+0000 7f1f4c0e3640 -1 osd.1 301 handle_osd_map injecting map crc failure 2026-02-24T17:30:08.831 INFO:tasks.ceph.osd.7.trial120.stderr:2026-02-24T17:30:08.827+0000 7f09b1cb0640 -1 osd.7 301 handle_osd_map injecting map crc failure 2026-02-24T17:30:10.278 INFO:tasks.ceph.osd.9.trial094.stderr:2026-02-24T17:30:10.276+0000 7fed2dec0640 -1 osd.9 304 handle_osd_map injecting map crc failure 2026-02-24T17:30:11.281 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-24T17:30:11.276+0000 7fb6af2ac640 -1 osd.2 305 handle_osd_map injecting map crc failure 2026-02-24T17:30:13.518 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:30:13.519+0000 7fe8108d8640 -1 osd.4 306 handle_osd_map injecting map crc failure 2026-02-24T17:30:15.294 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:30:15.291+0000 7f9cfbed1640 -1 osd.3 309 handle_osd_map injecting map crc failure 2026-02-24T17:30:15.295 INFO:tasks.ceph.osd.3.trial120.stderr:2026-02-24T17:30:15.291+0000 7f9cfbed1640 -1 osd.3 309 handle_osd_map injecting map crc failure 2026-02-24T17:30:15.644 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=180 2026-02-24T17:30:15.645 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 180 seconds' 2026-02-24T17:30:15.645 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 180 seconds 2026-02-24T17:30:15.645 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 180 -ge 5400 ']' 2026-02-24T17:30:15.646 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:30:15.646 INFO:tasks.workunit.client.0.trial120.stderr:+ sleep 10 2026-02-24T17:30:16.300 INFO:tasks.ceph.osd.8.trial040.stderr:2026-02-24T17:30:16.299+0000 7ff66534f640 -1 osd.8 310 handle_osd_map injecting map crc failure 2026-02-24T17:30:16.310 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6008 ms) 2026-02-24T17:30:16.310 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-24T17:30:16.310 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3021 ms) 2026-02-24T17:30:16.310 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-24T17:30:16.310 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6019 ms) 2026-02-24T17:30:16.310 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6036 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (6023 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (6007 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (6040 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6020 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (120649 ms total) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (3 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (0 ms) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (3 ms total) 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: 2026-02-24T17:30:16.311 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-24T17:30:16.312 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (280783 ms total) 2026-02-24T17:30:16.312 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-24T17:30:16.312 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-24T17:30:16.312 INFO:tasks.workunit.client.0.trial120.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-24T17:30:16.813 INFO:tasks.ceph.osd.4.trial040.stderr:2026-02-24T17:30:16.815+0000 7fe8108d8640 -1 osd.4 310 handle_osd_map injecting map crc failure 2026-02-24T17:30:16.814 INFO:tasks.ceph.osd.11.trial120.stderr:2026-02-24T17:30:16.810+0000 7fd22b908640 -1 osd.11 310 handle_osd_map injecting map crc failure 2026-02-24T17:30:25.646 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=190 2026-02-24T17:30:25.646 INFO:tasks.workunit.client.0.trial120.stdout:Waiting for test api_aio_pp (PID 20233)... waited 190 seconds 2026-02-24T17:30:25.648 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Waiting for test api_aio_pp (PID 20233)... waited 190 seconds' 2026-02-24T17:30:25.648 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 190 -ge 5400 ']' 2026-02-24T17:30:25.648 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20233 2026-02-24T17:30:25.648 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20233 2026-02-24T17:30:25.648 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.648 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.648 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.649 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.649 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20249 2026-02-24T17:30:25.649 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_io_pp (PID 20249)... 2026-02-24T17:30:25.650 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_io_pp (PID 20249)...' 2026-02-24T17:30:25.650 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20249 2026-02-24T17:30:25.650 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20249 2026-02-24T17:30:25.650 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.650 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.651 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.651 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.651 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test misc (PID 20958)... 2026-02-24T17:30:25.652 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20958 2026-02-24T17:30:25.652 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test misc (PID 20958)...' 2026-02-24T17:30:25.652 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20958 2026-02-24T17:30:25.652 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20958 2026-02-24T17:30:25.652 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.652 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.652 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.653 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.653 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20388 2026-02-24T17:30:25.653 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_snapshots_pp (PID 20388)... 2026-02-24T17:30:25.654 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_snapshots_pp (PID 20388)...' 2026-02-24T17:30:25.654 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20388 2026-02-24T17:30:25.654 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20388 2026-02-24T17:30:25.654 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.654 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.654 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.655 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.655 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21026 2026-02-24T17:30:25.655 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test read_operations (PID 21026)... 2026-02-24T17:30:25.656 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test read_operations (PID 21026)...' 2026-02-24T17:30:25.656 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 21026 2026-02-24T17:30:25.656 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 21026 2026-02-24T17:30:25.656 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.656 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.656 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.656 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.657 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_watch_notify (PID 20450)... 2026-02-24T17:30:25.657 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20450 2026-02-24T17:30:25.658 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_watch_notify (PID 20450)...' 2026-02-24T17:30:25.658 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20450 2026-02-24T17:30:25.658 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20450 2026-02-24T17:30:25.658 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.658 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.658 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.658 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.658 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20796 2026-02-24T17:30:25.659 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test handler_error (PID 20796)... 2026-02-24T17:30:25.659 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test handler_error (PID 20796)...' 2026-02-24T17:30:25.659 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20796 2026-02-24T17:30:25.659 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20796 2026-02-24T17:30:25.659 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.660 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.660 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.660 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.660 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test watch_notify (PID 21092)... 2026-02-24T17:30:25.661 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21092 2026-02-24T17:30:25.661 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test watch_notify (PID 21092)...' 2026-02-24T17:30:25.661 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 21092 2026-02-24T17:30:25.661 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 21092 2026-02-24T17:30:25.661 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.661 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.661 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.661 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.662 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20403 2026-02-24T17:30:25.662 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_stat (PID 20403)... 2026-02-24T17:30:25.662 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_stat (PID 20403)...' 2026-02-24T17:30:25.663 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20403 2026-02-24T17:30:25.663 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20403 2026-02-24T17:30:25.663 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.663 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.663 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.663 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.663 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20719 2026-02-24T17:30:25.663 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test open_pools_parallel (PID 20719)... 2026-02-24T17:30:25.664 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test open_pools_parallel (PID 20719)...' 2026-02-24T17:30:25.664 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20719 2026-02-24T17:30:25.664 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20719 2026-02-24T17:30:25.664 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.664 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.664 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.664 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.665 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20918 2026-02-24T17:30:25.665 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test ec_list (PID 20918)...' 2026-02-24T17:30:25.665 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test ec_list (PID 20918)... 2026-02-24T17:30:25.665 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20918 2026-02-24T17:30:25.666 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20918 2026-02-24T17:30:25.666 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.666 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.666 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.666 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.666 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20778 2026-02-24T17:30:25.666 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test cmd (PID 20778)... 2026-02-24T17:30:25.667 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test cmd (PID 20778)...' 2026-02-24T17:30:25.667 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20778 2026-02-24T17:30:25.667 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20778 2026-02-24T17:30:25.667 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.667 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.667 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.667 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.667 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21008 2026-02-24T17:30:25.668 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test pool (PID 21008)... 2026-02-24T17:30:25.668 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test pool (PID 21008)...' 2026-02-24T17:30:25.668 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 21008 2026-02-24T17:30:25.668 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 21008 2026-02-24T17:30:25.668 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.668 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.669 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.669 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.669 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_c_read_operations (PID 20648)... 2026-02-24T17:30:25.669 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20648 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_c_read_operations (PID 20648)...' 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20648 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20648 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20362 2026-02-24T17:30:25.670 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_pool (PID 20362)... 2026-02-24T17:30:25.671 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_pool (PID 20362)...' 2026-02-24T17:30:25.671 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20362 2026-02-24T17:30:25.671 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20362 2026-02-24T17:30:25.671 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.671 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.671 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.671 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.671 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21062 2026-02-24T17:30:25.672 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test snapshots (PID 21062)... 2026-02-24T17:30:25.672 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test snapshots (PID 21062)...' 2026-02-24T17:30:25.672 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 21062 2026-02-24T17:30:25.672 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 21062 2026-02-24T17:30:25.672 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.672 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.673 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.673 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.673 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20562 2026-02-24T17:30:25.673 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_service (PID 20562)... 2026-02-24T17:30:25.673 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_service (PID 20562)...' 2026-02-24T17:30:25.673 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20562 2026-02-24T17:30:25.674 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20562 2026-02-24T17:30:25.674 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.674 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.674 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.674 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.674 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20225 2026-02-24T17:30:25.674 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_aio (PID 20225)... 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_aio (PID 20225)...' 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20225 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20225 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20265 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_list (PID 20265)...' 2026-02-24T17:30:25.675 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_list (PID 20265)... 2026-02-24T17:30:25.676 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20265 2026-02-24T17:30:25.676 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20265 2026-02-24T17:30:25.676 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.676 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_cmd (PID 20493)... 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20493 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_cmd (PID 20493)...' 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20493 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20493 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.677 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20288 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_lock_pp (PID 20288)... 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_lock_pp (PID 20288)...' 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20288 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20288 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.678 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20592 2026-02-24T17:30:25.679 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_service_pp (PID 20592)... 2026-02-24T17:30:25.679 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_service_pp (PID 20592)...' 2026-02-24T17:30:25.679 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20592 2026-02-24T17:30:25.679 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20592 2026-02-24T17:30:25.679 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.679 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.679 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.680 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.680 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20624 2026-02-24T17:30:25.680 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test api_c_write_operations (PID 20624)... 2026-02-24T17:30:25.680 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test api_c_write_operations (PID 20624)...' 2026-02-24T17:30:25.680 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20624 2026-02-24T17:30:25.680 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20624 2026-02-24T17:30:25.680 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.681 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.681 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.681 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.681 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=20862 2026-02-24T17:30:25.681 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test list (PID 20862)... 2026-02-24T17:30:25.681 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test list (PID 20862)...' 2026-02-24T17:30:25.681 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 20862 2026-02-24T17:30:25.681 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 20862 2026-02-24T17:30:25.682 INFO:tasks.workunit.client.0.trial120.stderr:+ for t in "${!pids[@]}" 2026-02-24T17:30:25.682 INFO:tasks.workunit.client.0.trial120.stderr:+ max_wait=5400 2026-02-24T17:30:25.682 INFO:tasks.workunit.client.0.trial120.stderr:+ waited=0 2026-02-24T17:30:25.682 INFO:tasks.workunit.client.0.trial120.stderr:+ check_interval=10 2026-02-24T17:30:25.682 INFO:tasks.workunit.client.0.trial120.stderr:+ pid=21107 2026-02-24T17:30:25.682 INFO:tasks.workunit.client.0.trial120.stdout:Checking Test write_operations (PID 21107)... 2026-02-24T17:30:25.683 INFO:tasks.workunit.client.0.trial120.stderr:+ echo 'Checking Test write_operations (PID 21107)...' 2026-02-24T17:30:25.683 INFO:tasks.workunit.client.0.trial120.stderr:+ kill -0 21107 2026-02-24T17:30:25.683 INFO:tasks.workunit.client.0.trial120.stderr:+ wait 21107 2026-02-24T17:30:25.683 INFO:tasks.workunit.client.0.trial120.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T17:30:25.683 INFO:tasks.workunit.client.0.trial120.stderr:+ exit 0 2026-02-24T17:30:25.683 INFO:tasks.workunit.client.0.trial120.stderr:+ cleanup 2026-02-24T17:30:25.683 INFO:tasks.workunit.client.0.trial120.stderr:+ pkill -P 20219 2026-02-24T17:30:25.683 INFO:tasks.workunit.client.0.trial120.stderr:+ true 2026-02-24T17:30:25.684 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-24T17:30:25.684 DEBUG:teuthology.orchestra.run.trial120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-24T17:30:25.693 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2026-02-24T17:30:25.693 DEBUG:teuthology.orchestra.run.trial120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-24T17:30:26.046 DEBUG:teuthology.parallel:result is None 2026-02-24T17:30:26.047 DEBUG:teuthology.orchestra.run.trial120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T17:30:26.056 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T17:30:26.057 DEBUG:teuthology.orchestra.run.trial120:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T17:30:26.101 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T17:30:26.101 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-24T17:30:26.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T17:30:26.113 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T17:30:26.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.183+0000 7f3ce0674640 1 Processor -- start 2026-02-24T17:30:26.185 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.183+0000 7f3ce0674640 1 -- start start 2026-02-24T17:30:26.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f3cd80b5030 0x7f3cd8054260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f3cd80547a0 0x7f3cd805c660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd8054c20 con 0x7f3cd815cfe0 2026-02-24T17:30:26.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd8059530 con 0x7f3cd80547a0 2026-02-24T17:30:26.188 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd8058640 con 0x7f3cd80b5030 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cde3e9640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7f3cd815cfe0 0x7f3cd80b4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:55856/0 (socket says 10.20.193.40:55856) 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cde3e9640 1 -- 10.20.193.40:0/784780718 learned_addr learned my addr 10.20.193.40:0/784780718 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cddbe8640 1 --2- 10.20.193.40:0/784780718 >> v2:10.20.193.109:3300/0 conn(0x7f3cd80b5030 0x7f3cd8054260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdebea640 1 --2- 10.20.193.40:0/784780718 >> v2:10.20.193.94:3300/0 conn(0x7f3cd80547a0 0x7f3cd805c660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdebea640 1 -- 10.20.193.40:0/784780718 >> v2:10.20.193.109:3300/0 conn(0x7f3cd80b5030 msgr2=0x7f3cd8054260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdebea640 1 --2- 10.20.193.40:0/784780718 >> v2:10.20.193.109:3300/0 conn(0x7f3cd80b5030 0x7f3cd8054260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdebea640 1 -- 10.20.193.40:0/784780718 >> v1:10.20.193.94:6789/0 conn(0x7f3cd815cfe0 legacy=0x7f3cd80b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdebea640 1 -- 10.20.193.40:0/784780718 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd8058920 con 0x7f3cd80547a0 2026-02-24T17:30:26.189 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdebea640 1 --2- 10.20.193.40:0/784780718 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80547a0 0x7f3cd805c660 secure :-1 s=READY pgs=5178 gs=3 cs=0 l=1 c_cookie=10032496421298525313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cd4005c90 tx=0x7f3cd401d880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3a965739e05481 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdd3e7640 1 -- 10.20.193.40:0/784780718 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cd40b3070 con 0x7f3cd80547a0 2026-02-24T17:30:26.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdd3e7640 1 -- 10.20.193.40:0/784780718 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd40a6950 con 0x7f3cd80547a0 2026-02-24T17:30:26.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3cdd3e7640 1 -- 10.20.193.40:0/784780718 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cd40a6d60 con 0x7f3cd80547a0 2026-02-24T17:30:26.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- 10.20.193.40:0/784780718 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80547a0 msgr2=0x7f3cd805c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 --2- 10.20.193.40:0/784780718 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80547a0 0x7f3cd805c660 secure :-1 s=READY pgs=5178 gs=3 cs=0 l=1 c_cookie=10032496421298525313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cd4005c90 tx=0x7f3cd401d880 comp rx=0 tx=0).stop 2026-02-24T17:30:26.190 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- 10.20.193.40:0/784780718 shutdown_connections 2026-02-24T17:30:26.191 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 --2- 10.20.193.40:0/784780718 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80547a0 0x7f3cd805c660 unknown :-1 s=CLOSED pgs=5178 gs=3 cs=0 l=1 c_cookie=10032496421298525313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.191 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 --2- 10.20.193.40:0/784780718 >> v2:10.20.193.109:3300/0 conn(0x7f3cd80b5030 0x7f3cd8054260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.191 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- 10.20.193.40:0/784780718 >> 10.20.193.40:0/784780718 conn(0x7f3cd80b9b50 msgr2=0x7f3cd80b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:26.191 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- 10.20.193.40:0/784780718 shutdown_connections 2026-02-24T17:30:26.191 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- 10.20.193.40:0/784780718 wait complete. 2026-02-24T17:30:26.194 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 librados: starting msgr at 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 librados: starting objecter 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 Processor -- start 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 -- start start 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 librados: setting wanted keys 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.187+0000 7f3ce0674640 1 librados: calling monclient init 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3cd80547a0 0x7f3cd813ff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80b5030 0x7f3cd8135380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3cd815cfe0 0x7f3cd80b7d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd815d530 con 0x7f3cd815cfe0 2026-02-24T17:30:26.195 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd815d3b0 con 0x7f3cd80b5030 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd81673b0 con 0x7f3cd80547a0 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3cd815cfe0 0x7f3cd80b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3cd815cfe0 0x7f3cd80b7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57414/0 (socket says 10.20.193.40:57414) 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 -- 10.20.193.40:0/3791659126 learned_addr learned my addr 10.20.193.40:0/3791659126 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cde3e9640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3cd80547a0 0x7f3cd813ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cddbe8640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80b5030 0x7f3cd8135380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 -- 10.20.193.40:0/3791659126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3cd80547a0 msgr2=0x7f3cd813ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3cd80547a0 0x7f3cd813ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 -- 10.20.193.40:0/3791659126 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80b5030 msgr2=0x7f3cd8135380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80b5030 0x7f3cd8135380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 -- 10.20.193.40:0/3791659126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd8140620 con 0x7f3cd815cfe0 2026-02-24T17:30:26.196 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cdebea640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3cd815cfe0 0x7f3cd80b7d00 secure :-1 s=READY pgs=5144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cd401b4b0 tx=0x7f3cd401a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 10 client.?.objecter ms_handle_connect 0x7f3cd815cfe0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 1 -- 10.20.193.40:0/3791659126 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cd40bf070 con 0x7f3cd815cfe0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 1 -- 10.20.193.40:0/3791659126 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd40ae660 con 0x7f3cd815cfe0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd8140900 con 0x7f3cd815cfe0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 1 -- 10.20.193.40:0/3791659126 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cd40b3040 con 0x7f3cd815cfe0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 10 client.25293.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd8140ec0 con 0x7f3cd815cfe0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 librados: init done 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd8059a00 con 0x7f3cd815cfe0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 1 -- 10.20.193.40:0/3791659126 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f3cd40b6070 con 0x7f3cd815cfe0 2026-02-24T17:30:26.197 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 1 --2- 10.20.193.40:0/3791659126 >> v2:10.20.193.120:6800/397309233 conn(0x7f3ca8074100 0x7f3ca80945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.198 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 1 -- 10.20.193.40:0/3791659126 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f3cd4131a30 con 0x7f3cd815cfe0 2026-02-24T17:30:26.198 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 10 client.25293.objecter ms_dispatch2 0x7f3cd8000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:26.198 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 3 client.25293.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:26.198 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 3 client.25293.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:26.198 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cbeffd640 20 client.25293.objecter dump_active .. 0 homeless 2026-02-24T17:30:26.198 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.191+0000 7f3cde3e9640 1 --2- 10.20.193.40:0/3791659126 >> v2:10.20.193.120:6800/397309233 conn(0x7f3ca8074100 0x7f3ca80945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.198 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.195+0000 7f3cde3e9640 1 --2- 10.20.193.40:0/3791659126 >> v2:10.20.193.120:6800/397309233 conn(0x7f3ca8074100 0x7f3ca80945b0 secure :-1 s=READY pgs=2227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cc8002770 tx=0x7f3cc8007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.198 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.195+0000 7f3cbeffd640 10 client.25293.objecter ms_handle_connect 0x7f3ca8074100 2026-02-24T17:30:26.199 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.195+0000 7f3cbeffd640 1 -- 10.20.193.40:0/3791659126 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f3cd40174a0 con 0x7f3cd815cfe0 2026-02-24T17:30:26.281 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.283+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3cd805c660 con 0x7f3ca8074100 2026-02-24T17:30:26.284 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.283+0000 7f3cbeffd640 1 -- 10.20.193.40:0/3791659126 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+124926 (secure 0 0 0) 0x7f3cd805c660 con 0x7f3ca8074100 2026-02-24T17:30:26.284 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 10 librados: watch_flush enter 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 10 librados: watch_flush exit 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 20 client.25293.objecter shutdown clearing up homeless session... 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 10 client.25293.objecter successfully canceled tick 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 >> v2:10.20.193.120:6800/397309233 conn(0x7f3ca8074100 msgr2=0x7f3ca80945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 --2- 10.20.193.40:0/3791659126 >> v2:10.20.193.120:6800/397309233 conn(0x7f3ca8074100 0x7f3ca80945b0 secure :-1 s=READY pgs=2227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cc8002770 tx=0x7f3cc8007f90 comp rx=0 tx=0).stop 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3cd815cfe0 msgr2=0x7f3cd80b7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3cd815cfe0 0x7f3cd80b7d00 secure :-1 s=READY pgs=5144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cd401b4b0 tx=0x7f3cd401a620 comp rx=0 tx=0).stop 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 shutdown_connections 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 --2- 10.20.193.40:0/3791659126 >> v2:10.20.193.120:6800/397309233 conn(0x7f3ca8074100 0x7f3ca80945b0 unknown :-1 s=CLOSED pgs=2227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.285 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f3cd815cfe0 0x7f3cd80b7d00 unknown :-1 s=CLOSED pgs=5144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3cd80b5030 0x7f3cd8135380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 --2- 10.20.193.40:0/3791659126 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3cd80547a0 0x7f3cd813ff30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 >> 10.20.193.40:0/3791659126 conn(0x7f3cd80b9b50 msgr2=0x7f3cd8164fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:26.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 shutdown_connections 2026-02-24T17:30:26.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 -- 10.20.193.40:0/3791659126 wait complete. 2026-02-24T17:30:26.286 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.287+0000 7f3ce0674640 1 librados: shutdown 2026-02-24T17:30:26.295 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":465,"stamp":"2026-02-24T17:30:25.916166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":246,"num_write_kb":4773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":519372,"kb_used_data":88012,"kb_used_omap":25027,"kb_used_meta":406076,"kb_avail":1509430068,"statfs":{"total":1546188226560,"available":1545656389632,"internally_reserved":0,"allocated":90124288,"data_stored":53304971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25628640,"internal_metadata":415821856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001337"},"pg_stats":[{"pgid":"15.13","version":"0'0","reported_seq":565,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814772+0000","last_change":"2026-02-24T17:25:36.929977+0000","last_active":"2026-02-24T17:30:16.814772+0000","last_peered":"2026-02-24T17:30:16.814772+0000","last_clean":"2026-02-24T17:30:16.814772+0000","last_became_active":"2026-02-24T17:25:36.924928+0000","last_became_peered":"2026-02-24T17:25:36.924928+0000","last_unstale":"2026-02-24T17:30:16.814772+0000","last_undegraded":"2026-02-24T17:30:16.814772+0000","last_fullsized":"2026-02-24T17:30:16.814772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:49.788613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.894846+0000","last_change":"2026-02-24T17:25:36.978515+0000","last_active":"2026-02-24T17:30:16.894846+0000","last_peered":"2026-02-24T17:30:16.894846+0000","last_clean":"2026-02-24T17:30:16.894846+0000","last_became_active":"2026-02-24T17:25:36.978414+0000","last_became_peered":"2026-02-24T17:25:36.978414+0000","last_unstale":"2026-02-24T17:30:16.894846+0000","last_undegraded":"2026-02-24T17:30:16.894846+0000","last_fullsized":"2026-02-24T17:30:16.894846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:32:38.297792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816104+0000","last_change":"2026-02-24T17:25:36.967706+0000","last_active":"2026-02-24T17:30:16.816104+0000","last_peered":"2026-02-24T17:30:16.816104+0000","last_clean":"2026-02-24T17:30:16.816104+0000","last_became_active":"2026-02-24T17:25:36.967440+0000","last_became_peered":"2026-02-24T17:25:36.967440+0000","last_unstale":"2026-02-24T17:30:16.816104+0000","last_undegraded":"2026-02-24T17:30:16.816104+0000","last_fullsized":"2026-02-24T17:30:16.816104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:46:54.102811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.898865+0000","last_change":"2026-02-24T17:25:36.929256+0000","last_active":"2026-02-24T17:30:16.898865+0000","last_peered":"2026-02-24T17:30:16.898865+0000","last_clean":"2026-02-24T17:30:16.898865+0000","last_became_active":"2026-02-24T17:25:36.927701+0000","last_became_peered":"2026-02-24T17:25:36.927701+0000","last_unstale":"2026-02-24T17:30:16.898865+0000","last_undegraded":"2026-02-24T17:30:16.898865+0000","last_fullsized":"2026-02-24T17:30:16.898865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:24:25.599720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":557,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820632+0000","last_change":"2026-02-24T17:25:36.960677+0000","last_active":"2026-02-24T17:30:16.820632+0000","last_peered":"2026-02-24T17:30:16.820632+0000","last_clean":"2026-02-24T17:30:16.820632+0000","last_became_active":"2026-02-24T17:25:36.959978+0000","last_became_peered":"2026-02-24T17:25:36.959978+0000","last_unstale":"2026-02-24T17:30:16.820632+0000","last_undegraded":"2026-02-24T17:30:16.820632+0000","last_fullsized":"2026-02-24T17:30:16.820632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:44:53.723705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814494+0000","last_change":"2026-02-24T17:25:36.948273+0000","last_active":"2026-02-24T17:30:16.814494+0000","last_peered":"2026-02-24T17:30:16.814494+0000","last_clean":"2026-02-24T17:30:16.814494+0000","last_became_active":"2026-02-24T17:25:36.947821+0000","last_became_peered":"2026-02-24T17:25:36.947821+0000","last_unstale":"2026-02-24T17:30:16.814494+0000","last_undegraded":"2026-02-24T17:30:16.814494+0000","last_fullsized":"2026-02-24T17:30:16.814494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:29:10.189794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":561,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307910+0000","last_change":"2026-02-24T17:25:36.971834+0000","last_active":"2026-02-24T17:30:16.307910+0000","last_peered":"2026-02-24T17:30:16.307910+0000","last_clean":"2026-02-24T17:30:16.307910+0000","last_became_active":"2026-02-24T17:25:36.971529+0000","last_became_peered":"2026-02-24T17:25:36.971529+0000","last_unstale":"2026-02-24T17:30:16.307910+0000","last_undegraded":"2026-02-24T17:30:16.307910+0000","last_fullsized":"2026-02-24T17:30:16.307910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:08:47.585158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307934+0000","last_change":"2026-02-24T17:25:36.971133+0000","last_active":"2026-02-24T17:30:16.307934+0000","last_peered":"2026-02-24T17:30:16.307934+0000","last_clean":"2026-02-24T17:30:16.307934+0000","last_became_active":"2026-02-24T17:25:36.970412+0000","last_became_peered":"2026-02-24T17:25:36.970412+0000","last_unstale":"2026-02-24T17:30:16.307934+0000","last_undegraded":"2026-02-24T17:30:16.307934+0000","last_fullsized":"2026-02-24T17:30:16.307934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:05:49.568228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420711+0000","last_change":"2026-02-24T17:25:37.009919+0000","last_active":"2026-02-24T17:30:16.420711+0000","last_peered":"2026-02-24T17:30:16.420711+0000","last_clean":"2026-02-24T17:30:16.420711+0000","last_became_active":"2026-02-24T17:25:37.003886+0000","last_became_peered":"2026-02-24T17:25:37.003886+0000","last_unstale":"2026-02-24T17:30:16.420711+0000","last_undegraded":"2026-02-24T17:30:16.420711+0000","last_fullsized":"2026-02-24T17:30:16.420711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:18:05.631610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.317722+0000","last_change":"2026-02-24T17:25:36.947604+0000","last_active":"2026-02-24T17:30:16.317722+0000","last_peered":"2026-02-24T17:30:16.317722+0000","last_clean":"2026-02-24T17:30:16.317722+0000","last_became_active":"2026-02-24T17:25:36.942964+0000","last_became_peered":"2026-02-24T17:25:36.942964+0000","last_unstale":"2026-02-24T17:30:16.317722+0000","last_undegraded":"2026-02-24T17:30:16.317722+0000","last_fullsized":"2026-02-24T17:30:16.317722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:12:13.180150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":557,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820192+0000","last_change":"2026-02-24T17:25:36.956652+0000","last_active":"2026-02-24T17:30:16.820192+0000","last_peered":"2026-02-24T17:30:16.820192+0000","last_clean":"2026-02-24T17:30:16.820192+0000","last_became_active":"2026-02-24T17:25:36.953877+0000","last_became_peered":"2026-02-24T17:25:36.953877+0000","last_unstale":"2026-02-24T17:30:16.820192+0000","last_undegraded":"2026-02-24T17:30:16.820192+0000","last_fullsized":"2026-02-24T17:30:16.820192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:17:49.908382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420679+0000","last_change":"2026-02-24T17:25:37.007119+0000","last_active":"2026-02-24T17:30:16.420679+0000","last_peered":"2026-02-24T17:30:16.420679+0000","last_clean":"2026-02-24T17:30:16.420679+0000","last_became_active":"2026-02-24T17:25:36.996719+0000","last_became_peered":"2026-02-24T17:25:36.996719+0000","last_unstale":"2026-02-24T17:30:16.420679+0000","last_undegraded":"2026-02-24T17:30:16.420679+0000","last_fullsized":"2026-02-24T17:30:16.420679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:07:13.684127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307925+0000","last_change":"2026-02-24T17:25:09.854702+0000","last_active":"2026-02-24T17:30:16.307925+0000","last_peered":"2026-02-24T17:30:16.307925+0000","last_clean":"2026-02-24T17:30:16.307925+0000","last_became_active":"2026-02-24T17:25:08.378421+0000","last_became_peered":"2026-02-24T17:25:08.378421+0000","last_unstale":"2026-02-24T17:30:16.307925+0000","last_undegraded":"2026-02-24T17:30:16.307925+0000","last_fullsized":"2026-02-24T17:30:16.307925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:44.939627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816773+0000","last_change":"2026-02-24T17:25:36.961132+0000","last_active":"2026-02-24T17:30:16.816773+0000","last_peered":"2026-02-24T17:30:16.816773+0000","last_clean":"2026-02-24T17:30:16.816773+0000","last_became_active":"2026-02-24T17:25:36.959088+0000","last_became_peered":"2026-02-24T17:25:36.959088+0000","last_unstale":"2026-02-24T17:30:16.816773+0000","last_undegraded":"2026-02-24T17:30:16.816773+0000","last_fullsized":"2026-02-24T17:30:16.816773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:49:13.731672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":580,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814870+0000","last_change":"2026-02-24T17:25:10.079278+0000","last_active":"2026-02-24T17:30:16.814870+0000","last_peered":"2026-02-24T17:30:16.814870+0000","last_clean":"2026-02-24T17:30:16.814870+0000","last_became_active":"2026-02-24T17:25:07.858311+0000","last_became_peered":"2026-02-24T17:25:07.858311+0000","last_unstale":"2026-02-24T17:30:16.814870+0000","last_undegraded":"2026-02-24T17:30:16.814870+0000","last_fullsized":"2026-02-24T17:30:16.814870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:29:45.741836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030397399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816056+0000","last_change":"2026-02-24T17:25:36.951453+0000","last_active":"2026-02-24T17:30:16.816056+0000","last_peered":"2026-02-24T17:30:16.816056+0000","last_clean":"2026-02-24T17:30:16.816056+0000","last_became_active":"2026-02-24T17:25:36.949632+0000","last_became_peered":"2026-02-24T17:25:36.949632+0000","last_unstale":"2026-02-24T17:30:16.816056+0000","last_undegraded":"2026-02-24T17:30:16.816056+0000","last_fullsized":"2026-02-24T17:30:16.816056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:29:49.423443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":575,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.305860+0000","last_change":"2026-02-24T17:25:10.081728+0000","last_active":"2026-02-24T17:30:16.305860+0000","last_peered":"2026-02-24T17:30:16.305860+0000","last_clean":"2026-02-24T17:30:16.305860+0000","last_became_active":"2026-02-24T17:25:08.084075+0000","last_became_peered":"2026-02-24T17:25:08.084075+0000","last_unstale":"2026-02-24T17:30:16.305860+0000","last_undegraded":"2026-02-24T17:30:16.305860+0000","last_fullsized":"2026-02-24T17:30:16.305860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:51:08.211087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000244684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816505+0000","last_change":"2026-02-24T17:25:36.950428+0000","last_active":"2026-02-24T17:30:16.816505+0000","last_peered":"2026-02-24T17:30:16.816505+0000","last_clean":"2026-02-24T17:30:16.816505+0000","last_became_active":"2026-02-24T17:25:36.941218+0000","last_became_peered":"2026-02-24T17:25:36.941218+0000","last_unstale":"2026-02-24T17:30:16.816505+0000","last_undegraded":"2026-02-24T17:30:16.816505+0000","last_fullsized":"2026-02-24T17:30:16.816505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:09:01.212669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816182+0000","last_change":"2026-02-24T17:25:10.079275+0000","last_active":"2026-02-24T17:30:16.816182+0000","last_peered":"2026-02-24T17:30:16.816182+0000","last_clean":"2026-02-24T17:30:16.816182+0000","last_became_active":"2026-02-24T17:25:07.858281+0000","last_became_peered":"2026-02-24T17:25:07.858281+0000","last_unstale":"2026-02-24T17:30:16.816182+0000","last_undegraded":"2026-02-24T17:30:16.816182+0000","last_fullsized":"2026-02-24T17:30:16.816182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:14.965746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028402800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":560,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.899720+0000","last_change":"2026-02-24T17:25:36.944241+0000","last_active":"2026-02-24T17:30:16.899720+0000","last_peered":"2026-02-24T17:30:16.899720+0000","last_clean":"2026-02-24T17:30:16.899720+0000","last_became_active":"2026-02-24T17:25:36.943923+0000","last_became_peered":"2026-02-24T17:25:36.943923+0000","last_unstale":"2026-02-24T17:30:16.899720+0000","last_undegraded":"2026-02-24T17:30:16.899720+0000","last_fullsized":"2026-02-24T17:30:16.899720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:26.543240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":579,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307888+0000","last_change":"2026-02-24T17:25:09.855093+0000","last_active":"2026-02-24T17:30:16.307888+0000","last_peered":"2026-02-24T17:30:16.307888+0000","last_clean":"2026-02-24T17:30:16.307888+0000","last_became_active":"2026-02-24T17:25:08.074872+0000","last_became_peered":"2026-02-24T17:25:08.074872+0000","last_unstale":"2026-02-24T17:30:16.307888+0000","last_undegraded":"2026-02-24T17:30:16.307888+0000","last_fullsized":"2026-02-24T17:30:16.307888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:30:27.324702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089238299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":558,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820494+0000","last_change":"2026-02-24T17:25:36.948717+0000","last_active":"2026-02-24T17:30:16.820494+0000","last_peered":"2026-02-24T17:30:16.820494+0000","last_clean":"2026-02-24T17:30:16.820494+0000","last_became_active":"2026-02-24T17:25:36.947822+0000","last_became_peered":"2026-02-24T17:25:36.947822+0000","last_unstale":"2026-02-24T17:30:16.820494+0000","last_undegraded":"2026-02-24T17:30:16.820494+0000","last_fullsized":"2026-02-24T17:30:16.820494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:21:50.762760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303454+0000","last_change":"2026-02-24T17:25:10.079008+0000","last_active":"2026-02-24T17:30:16.303454+0000","last_peered":"2026-02-24T17:30:16.303454+0000","last_clean":"2026-02-24T17:30:16.303454+0000","last_became_active":"2026-02-24T17:25:07.860331+0000","last_became_peered":"2026-02-24T17:25:07.860331+0000","last_unstale":"2026-02-24T17:30:16.303454+0000","last_undegraded":"2026-02-24T17:30:16.303454+0000","last_fullsized":"2026-02-24T17:30:16.303454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:34:57.054779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023849400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420746+0000","last_change":"2026-02-24T17:25:36.995572+0000","last_active":"2026-02-24T17:30:16.420746+0000","last_peered":"2026-02-24T17:30:16.420746+0000","last_clean":"2026-02-24T17:30:16.420746+0000","last_became_active":"2026-02-24T17:25:36.988342+0000","last_became_peered":"2026-02-24T17:25:36.988342+0000","last_unstale":"2026-02-24T17:30:16.420746+0000","last_undegraded":"2026-02-24T17:30:16.420746+0000","last_fullsized":"2026-02-24T17:30:16.420746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:49.223919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307719+0000","last_change":"2026-02-24T17:25:09.854861+0000","last_active":"2026-02-24T17:30:16.307719+0000","last_peered":"2026-02-24T17:30:16.307719+0000","last_clean":"2026-02-24T17:30:16.307719+0000","last_became_active":"2026-02-24T17:25:08.184697+0000","last_became_peered":"2026-02-24T17:25:08.184697+0000","last_unstale":"2026-02-24T17:30:16.307719+0000","last_undegraded":"2026-02-24T17:30:16.307719+0000","last_fullsized":"2026-02-24T17:30:16.307719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:43:33.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064636800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420858+0000","last_change":"2026-02-24T17:25:37.008582+0000","last_active":"2026-02-24T17:30:16.420858+0000","last_peered":"2026-02-24T17:30:16.420858+0000","last_clean":"2026-02-24T17:30:16.420858+0000","last_became_active":"2026-02-24T17:25:36.995692+0000","last_became_peered":"2026-02-24T17:25:36.995692+0000","last_unstale":"2026-02-24T17:30:16.420858+0000","last_undegraded":"2026-02-24T17:30:16.420858+0000","last_fullsized":"2026-02-24T17:30:16.420858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:44:14.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":578,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303566+0000","last_change":"2026-02-24T17:25:10.079028+0000","last_active":"2026-02-24T17:30:16.303566+0000","last_peered":"2026-02-24T17:30:16.303566+0000","last_clean":"2026-02-24T17:30:16.303566+0000","last_became_active":"2026-02-24T17:25:08.090187+0000","last_became_peered":"2026-02-24T17:25:08.090187+0000","last_unstale":"2026-02-24T17:30:16.303566+0000","last_undegraded":"2026-02-24T17:30:16.303566+0000","last_fullsized":"2026-02-24T17:30:16.303566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:14:10.801138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024157000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"25'192","reported_seq":803,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816341+0000","last_change":"2026-02-24T17:25:04.114588+0000","last_active":"2026-02-24T17:30:16.816341+0000","last_peered":"2026-02-24T17:30:16.816341+0000","last_clean":"2026-02-24T17:30:16.816341+0000","last_became_active":"2026-02-24T17:25:04.113696+0000","last_became_peered":"2026-02-24T17:25:04.113696+0000","last_unstale":"2026-02-24T17:30:16.816341+0000","last_undegraded":"2026-02-24T17:30:16.816341+0000","last_fullsized":"2026-02-24T17:30:16.816341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_clean_scrub_stamp":"2026-02-24T17:25:02.798744+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:55:22.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816130+0000","last_change":"2026-02-24T17:25:36.951158+0000","last_active":"2026-02-24T17:30:16.816130+0000","last_peered":"2026-02-24T17:30:16.816130+0000","last_clean":"2026-02-24T17:30:16.816130+0000","last_became_active":"2026-02-24T17:25:36.949323+0000","last_became_peered":"2026-02-24T17:25:36.949323+0000","last_unstale":"2026-02-24T17:30:16.816130+0000","last_undegraded":"2026-02-24T17:30:16.816130+0000","last_fullsized":"2026-02-24T17:30:16.816130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:00:33.896080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":558,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:17.105993+0000","last_change":"2026-02-24T17:25:36.939870+0000","last_active":"2026-02-24T17:30:17.105993+0000","last_peered":"2026-02-24T17:30:17.105993+0000","last_clean":"2026-02-24T17:30:17.105993+0000","last_became_active":"2026-02-24T17:25:36.939263+0000","last_became_peered":"2026-02-24T17:25:36.939263+0000","last_unstale":"2026-02-24T17:30:17.105993+0000","last_undegraded":"2026-02-24T17:30:17.105993+0000","last_fullsized":"2026-02-24T17:30:17.105993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:00:46.910276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816440+0000","last_change":"2026-02-24T17:25:36.938520+0000","last_active":"2026-02-24T17:30:16.816440+0000","last_peered":"2026-02-24T17:30:16.816440+0000","last_clean":"2026-02-24T17:30:16.816440+0000","last_became_active":"2026-02-24T17:25:36.936185+0000","last_became_peered":"2026-02-24T17:25:36.936185+0000","last_unstale":"2026-02-24T17:30:16.816440+0000","last_undegraded":"2026-02-24T17:30:16.816440+0000","last_fullsized":"2026-02-24T17:30:16.816440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:09:43.790677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303659+0000","last_change":"2026-02-24T17:25:36.953789+0000","last_active":"2026-02-24T17:30:16.303659+0000","last_peered":"2026-02-24T17:30:16.303659+0000","last_clean":"2026-02-24T17:30:16.303659+0000","last_became_active":"2026-02-24T17:25:36.949495+0000","last_became_peered":"2026-02-24T17:25:36.949495+0000","last_unstale":"2026-02-24T17:30:16.303659+0000","last_undegraded":"2026-02-24T17:30:16.303659+0000","last_fullsized":"2026-02-24T17:30:16.303659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:10.043156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816224+0000","last_change":"2026-02-24T17:25:36.988365+0000","last_active":"2026-02-24T17:30:16.816224+0000","last_peered":"2026-02-24T17:30:16.816224+0000","last_clean":"2026-02-24T17:30:16.816224+0000","last_became_active":"2026-02-24T17:25:36.988207+0000","last_became_peered":"2026-02-24T17:25:36.988207+0000","last_unstale":"2026-02-24T17:30:16.816224+0000","last_undegraded":"2026-02-24T17:30:16.816224+0000","last_fullsized":"2026-02-24T17:30:16.816224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:44:31.138787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420667+0000","last_change":"2026-02-24T17:25:37.008436+0000","last_active":"2026-02-24T17:30:16.420667+0000","last_peered":"2026-02-24T17:30:16.420667+0000","last_clean":"2026-02-24T17:30:16.420667+0000","last_became_active":"2026-02-24T17:25:37.002254+0000","last_became_peered":"2026-02-24T17:25:37.002254+0000","last_unstale":"2026-02-24T17:30:16.420667+0000","last_undegraded":"2026-02-24T17:30:16.420667+0000","last_fullsized":"2026-02-24T17:30:16.420667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:10:08.553481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"32'11","reported_seq":584,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:17.105921+0000","last_change":"2026-02-24T17:25:36.955772+0000","last_active":"2026-02-24T17:30:17.105921+0000","last_peered":"2026-02-24T17:30:17.105921+0000","last_clean":"2026-02-24T17:30:17.105921+0000","last_became_active":"2026-02-24T17:25:36.954370+0000","last_became_peered":"2026-02-24T17:25:36.954370+0000","last_unstale":"2026-02-24T17:30:17.105921+0000","last_undegraded":"2026-02-24T17:30:17.105921+0000","last_fullsized":"2026-02-24T17:30:17.105921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:00:02.410830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816819+0000","last_change":"2026-02-24T17:25:36.967349+0000","last_active":"2026-02-24T17:30:16.816819+0000","last_peered":"2026-02-24T17:30:16.816819+0000","last_clean":"2026-02-24T17:30:16.816819+0000","last_became_active":"2026-02-24T17:25:36.967164+0000","last_became_peered":"2026-02-24T17:25:36.967164+0000","last_unstale":"2026-02-24T17:30:16.816819+0000","last_undegraded":"2026-02-24T17:30:16.816819+0000","last_fullsized":"2026-02-24T17:30:16.816819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:24:47.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":561,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.603289+0000","last_change":"2026-02-24T17:25:36.943423+0000","last_active":"2026-02-24T17:30:16.603289+0000","last_peered":"2026-02-24T17:30:16.603289+0000","last_clean":"2026-02-24T17:30:16.603289+0000","last_became_active":"2026-02-24T17:25:36.941089+0000","last_became_peered":"2026-02-24T17:25:36.941089+0000","last_unstale":"2026-02-24T17:30:16.603289+0000","last_undegraded":"2026-02-24T17:30:16.603289+0000","last_fullsized":"2026-02-24T17:30:16.603289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:21:37.674638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816167+0000","last_change":"2026-02-24T17:25:36.939435+0000","last_active":"2026-02-24T17:30:16.816167+0000","last_peered":"2026-02-24T17:30:16.816167+0000","last_clean":"2026-02-24T17:30:16.816167+0000","last_became_active":"2026-02-24T17:25:36.938491+0000","last_became_peered":"2026-02-24T17:25:36.938491+0000","last_unstale":"2026-02-24T17:30:16.816167+0000","last_undegraded":"2026-02-24T17:30:16.816167+0000","last_fullsized":"2026-02-24T17:30:16.816167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:36:23.352712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":560,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.603937+0000","last_change":"2026-02-24T17:25:36.938161+0000","last_active":"2026-02-24T17:30:16.603937+0000","last_peered":"2026-02-24T17:30:16.603937+0000","last_clean":"2026-02-24T17:30:16.603937+0000","last_became_active":"2026-02-24T17:25:36.937025+0000","last_became_peered":"2026-02-24T17:25:36.937025+0000","last_unstale":"2026-02-24T17:30:16.603937+0000","last_undegraded":"2026-02-24T17:30:16.603937+0000","last_fullsized":"2026-02-24T17:30:16.603937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:40:14.141988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420968+0000","last_change":"2026-02-24T17:25:36.988471+0000","last_active":"2026-02-24T17:30:16.420968+0000","last_peered":"2026-02-24T17:30:16.420968+0000","last_clean":"2026-02-24T17:30:16.420968+0000","last_became_active":"2026-02-24T17:25:36.985324+0000","last_became_peered":"2026-02-24T17:25:36.985324+0000","last_unstale":"2026-02-24T17:30:16.420968+0000","last_undegraded":"2026-02-24T17:30:16.420968+0000","last_fullsized":"2026-02-24T17:30:16.420968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:56:48.935815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.899835+0000","last_change":"2026-02-24T17:25:36.928873+0000","last_active":"2026-02-24T17:30:16.899835+0000","last_peered":"2026-02-24T17:30:16.899835+0000","last_clean":"2026-02-24T17:30:16.899835+0000","last_became_active":"2026-02-24T17:25:36.928525+0000","last_became_peered":"2026-02-24T17:25:36.928525+0000","last_unstale":"2026-02-24T17:30:16.899835+0000","last_undegraded":"2026-02-24T17:30:16.899835+0000","last_fullsized":"2026-02-24T17:30:16.899835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:02:20.618977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":2,"acting":2,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":2,"up_from":21,"seq":90194313282,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3248436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189403,"internal_metadata":27401253},"hb_peers":[0,1,3,4,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":21,"seq":90194313283,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2937,"kb_used_meta":24006,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3252877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3007961,"internal_metadata":24582695},"hb_peers":[0,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2993,"kb_used_meta":23950,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3267610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3065731,"internal_metadata":24524925},"hb_peers":[0,4,5,6,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313284,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":5412,"kb_used_omap":2970,"kb_used_meta":23973,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":5541888,"data_stored":3259528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3041792,"internal_metadata":24548864},"hb_peers":[1,3,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313283,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":5444,"kb_used_omap":5476,"kb_used_meta":21467,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":5574656,"data_stored":3262696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5607519,"internal_metadata":21983137},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313282,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":5400,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":5529600,"data_stored":3255127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[0,2,3,4,6,7,9,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3264371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3063988,"internal_metadata":24526668},"hb_peers":[0,2,4,5,7,8,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313282,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":183,"kb_used_meta":26760,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3244929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187407,"internal_metadata":27403249},"hb_peers":[1,3,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313283,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":5976,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":6119424,"data_stored":3835511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":192289,"internal_metadata":27398367},"hb_peers":[2,4,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":6020,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":6164480,"data_stored":3841297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188812,"internal_metadata":27401844},"hb_peers":[0,1,3,5,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":5468,"kb_used_omap":188,"kb_used_meta":26755,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":5599232,"data_stored":3272622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":193209,"internal_metadata":27397447},"hb_peers":[0,1,6,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":5448,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":5578752,"data_stored":3262562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":191672,"internal_metadata":27398984},"hb_peers":[0,3,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":5404,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":5533696,"data_stored":3252627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[2,4,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313282,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":5436,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":5566464,"data_stored":3261683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3064212,"internal_metadata":24526444},"hb_peers":[0,4,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313282,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2994,"kb_used_meta":23949,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3265804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3066142,"internal_metadata":24524514},"hb_peers":[0,2,3,4,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3257291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190563,"internal_metadata":27400093},"hb_peers":[1,3,4,6,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T17:30:26.296 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T17:30:26.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 Processor -- start 2026-02-24T17:30:26.357 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- start start 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f481815d310 0x7f48180bc340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f481815d6e0 0x7f48180baeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48180b4450 con 0x7f48180bb3f0 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f48180bb880 con 0x7f481815d6e0 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f48180bbb60 con 0x7f481815d310 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f48177fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f481815d6e0 0x7f48180baeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f48177fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f481815d6e0 0x7f48180baeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57422/0 (socket says 10.20.193.40:57422) 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f48177fe640 1 -- 10.20.193.40:0/3956029435 learned_addr learned my addr 10.20.193.40:0/3956029435 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f4817fff640 1 --2- 10.20.193.40:0/3956029435 >> v2:10.20.193.109:3300/0 conn(0x7f481815d310 0x7f48180bc340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f48177fe640 1 -- 10.20.193.40:0/3956029435 >> v2:10.20.193.109:3300/0 conn(0x7f481815d310 msgr2=0x7f48180bc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f48177fe640 1 --2- 10.20.193.40:0/3956029435 >> v2:10.20.193.109:3300/0 conn(0x7f481815d310 0x7f48180bc340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f48177fe640 1 -- 10.20.193.40:0/3956029435 >> v1:10.20.193.109:6789/0 conn(0x7f48180bb3f0 legacy=0x7f48180b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f48177fe640 1 -- 10.20.193.40:0/3956029435 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48180b46f0 con 0x7f481815d6e0 2026-02-24T17:30:26.358 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f4817fff640 1 --2- 10.20.193.40:0/3956029435 >> v2:10.20.193.109:3300/0 conn(0x7f481815d310 0x7f48180bc340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:30:26.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f48177fe640 1 --2- 10.20.193.40:0/3956029435 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d6e0 0x7f48180baeb0 secure :-1 s=READY pgs=5145 gs=2 cs=0 l=1 c_cookie=3353258144588925232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48080090a0 tx=0x7f480801c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e892a8424688930 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f4816ffd640 1 -- 10.20.193.40:0/3956029435 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f48080aa680 con 0x7f481815d6e0 2026-02-24T17:30:26.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f4816ffd640 1 -- 10.20.193.40:0/3956029435 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48080af070 con 0x7f481815d6e0 2026-02-24T17:30:26.359 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f4816ffd640 1 -- 10.20.193.40:0/3956029435 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f48080aaa60 con 0x7f481815d6e0 2026-02-24T17:30:26.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- 10.20.193.40:0/3956029435 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d6e0 msgr2=0x7f48180baeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 --2- 10.20.193.40:0/3956029435 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d6e0 0x7f48180baeb0 secure :-1 s=READY pgs=5145 gs=2 cs=0 l=1 c_cookie=3353258144588925232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48080090a0 tx=0x7f480801c5b0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- 10.20.193.40:0/3956029435 shutdown_connections 2026-02-24T17:30:26.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 --2- 10.20.193.40:0/3956029435 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d6e0 0x7f48180baeb0 unknown :-1 s=CLOSED pgs=5145 gs=2 cs=0 l=1 c_cookie=3353258144588925232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 --2- 10.20.193.40:0/3956029435 >> v2:10.20.193.109:3300/0 conn(0x7f481815d310 0x7f48180bc340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- 10.20.193.40:0/3956029435 >> 10.20.193.40:0/3956029435 conn(0x7f48180bd180 msgr2=0x7f48180bd580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:26.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- 10.20.193.40:0/3956029435 shutdown_connections 2026-02-24T17:30:26.360 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- 10.20.193.40:0/3956029435 wait complete. 2026-02-24T17:30:26.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 librados: starting msgr at 2026-02-24T17:30:26.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 librados: starting objecter 2026-02-24T17:30:26.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 Processor -- start 2026-02-24T17:30:26.364 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 -- start start 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 librados: setting wanted keys 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.359+0000 7f481e936640 1 librados: calling monclient init 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 0x7f4818167ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d310 0x7f481813d430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f481815d6e0 0x7f481817a640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f48181679b0 con 0x7f481815d310 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f4818167830 con 0x7f48180bb3f0 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f48181cd440 con 0x7f481815d6e0 2026-02-24T17:30:26.365 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d310 0x7f481813d430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.366 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d310 0x7f481813d430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57436/0 (socket says 10.20.193.40:57436) 2026-02-24T17:30:26.366 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 -- 10.20.193.40:0/3343574068 learned_addr learned my addr 10.20.193.40:0/3343574068 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:26.366 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4817fff640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 0x7f4818167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.366 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4817fff640 1 -- 10.20.193.40:0/3343574068 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 msgr2=0x7f4818167ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-24T17:30:26.366 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4817fff640 1 -- 10.20.193.40:0/3343574068 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 msgr2=0x7f4818167ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:30:26.366 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4817fff640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 0x7f4818167ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:30:26.366 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4817fff640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 0x7f4818167ea0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481ceac640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f481815d6e0 0x7f481817a640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 -- 10.20.193.40:0/3343574068 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f481815d6e0 msgr2=0x7f481817a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f481815d6e0 0x7f481817a640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 -- 10.20.193.40:0/3343574068 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 msgr2=0x7f4818167ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 0x7f4818167ea0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 -- 10.20.193.40:0/3343574068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4818168740 con 0x7f481815d310 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f48177fe640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d310 0x7f481813d430 secure :-1 s=READY pgs=5146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f480801ac60 tx=0x7f480801adf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 10 client.?.objecter ms_handle_connect 0x7f481815d310 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:26.367 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 1 -- 10.20.193.40:0/3343574068 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4808004250 con 0x7f481815d310 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 1 -- 10.20.193.40:0/3343574068 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48080043f0 con 0x7f481815d310 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4818168a20 con 0x7f481815d310 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 1 -- 10.20.193.40:0/3343574068 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4808003930 con 0x7f481815d310 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 10 client.25299.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4818168fe0 con 0x7f481815d310 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 librados: init done 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48180bc340 con 0x7f481815d310 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 1 -- 10.20.193.40:0/3343574068 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f4808003ad0 con 0x7f481815d310 2026-02-24T17:30:26.368 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 1 --2- 10.20.193.40:0/3343574068 >> v2:10.20.193.120:6800/397309233 conn(0x7f47e8074100 0x7f47e80945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.369 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 1 -- 10.20.193.40:0/3343574068 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f4808130ec0 con 0x7f481815d310 2026-02-24T17:30:26.369 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 10 client.25299.objecter ms_dispatch2 0x7f4818000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:26.369 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 3 client.25299.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:26.369 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 3 client.25299.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:26.369 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 20 client.25299.objecter dump_active .. 0 homeless 2026-02-24T17:30:26.369 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4817fff640 1 --2- 10.20.193.40:0/3343574068 >> v2:10.20.193.120:6800/397309233 conn(0x7f47e8074100 0x7f47e80945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.370 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4817fff640 1 --2- 10.20.193.40:0/3343574068 >> v2:10.20.193.120:6800/397309233 conn(0x7f47e8074100 0x7f47e80945b0 secure :-1 s=READY pgs=2228 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4804006fd0 tx=0x7f4804008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.370 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.363+0000 7f4814ff9640 10 client.25299.objecter ms_handle_connect 0x7f47e8074100 2026-02-24T17:30:26.370 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.367+0000 7f4814ff9640 1 -- 10.20.193.40:0/3343574068 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f48080161d0 con 0x7f481815d310 2026-02-24T17:30:26.449 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4818057810 con 0x7f47e8074100 2026-02-24T17:30:26.451 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f4814ff9640 1 -- 10.20.193.40:0/3343574068 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+124926 (secure 0 0 0) 0x7f4818057810 con 0x7f47e8074100 2026-02-24T17:30:26.453 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:30:26.454 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-24T17:30:26.456 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 10 librados: watch_flush enter 2026-02-24T17:30:26.456 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 10 librados: watch_flush exit 2026-02-24T17:30:26.456 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 20 client.25299.objecter shutdown clearing up homeless session... 2026-02-24T17:30:26.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 10 client.25299.objecter successfully canceled tick 2026-02-24T17:30:26.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 >> v2:10.20.193.120:6800/397309233 conn(0x7f47e8074100 msgr2=0x7f47e80945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 --2- 10.20.193.40:0/3343574068 >> v2:10.20.193.120:6800/397309233 conn(0x7f47e8074100 0x7f47e80945b0 secure :-1 s=READY pgs=2228 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4804006fd0 tx=0x7f4804008040 comp rx=0 tx=0).stop 2026-02-24T17:30:26.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d310 msgr2=0x7f481813d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d310 0x7f481813d430 secure :-1 s=READY pgs=5146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f480801ac60 tx=0x7f480801adf0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 shutdown_connections 2026-02-24T17:30:26.457 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 --2- 10.20.193.40:0/3343574068 >> v2:10.20.193.120:6800/397309233 conn(0x7f47e8074100 0x7f47e80945b0 unknown :-1 s=CLOSED pgs=2228 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f481815d6e0 0x7f481817a640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f481815d310 0x7f481813d430 unknown :-1 s=CLOSED pgs=5146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 --2- 10.20.193.40:0/3343574068 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f48180bb3f0 0x7f4818167ea0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 >> 10.20.193.40:0/3343574068 conn(0x7f48180bd180 msgr2=0x7f481815ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:26.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 shutdown_connections 2026-02-24T17:30:26.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 -- 10.20.193.40:0/3343574068 wait complete. 2026-02-24T17:30:26.458 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.451+0000 7f481e936640 1 librados: shutdown 2026-02-24T17:30:26.463 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":465,"stamp":"2026-02-24T17:30:25.916166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":246,"num_write_kb":4773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":519372,"kb_used_data":88012,"kb_used_omap":25027,"kb_used_meta":406076,"kb_avail":1509430068,"statfs":{"total":1546188226560,"available":1545656389632,"internally_reserved":0,"allocated":90124288,"data_stored":53304971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25628640,"internal_metadata":415821856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001337"},"pg_stats":[{"pgid":"15.13","version":"0'0","reported_seq":565,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814772+0000","last_change":"2026-02-24T17:25:36.929977+0000","last_active":"2026-02-24T17:30:16.814772+0000","last_peered":"2026-02-24T17:30:16.814772+0000","last_clean":"2026-02-24T17:30:16.814772+0000","last_became_active":"2026-02-24T17:25:36.924928+0000","last_became_peered":"2026-02-24T17:25:36.924928+0000","last_unstale":"2026-02-24T17:30:16.814772+0000","last_undegraded":"2026-02-24T17:30:16.814772+0000","last_fullsized":"2026-02-24T17:30:16.814772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:49.788613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.894846+0000","last_change":"2026-02-24T17:25:36.978515+0000","last_active":"2026-02-24T17:30:16.894846+0000","last_peered":"2026-02-24T17:30:16.894846+0000","last_clean":"2026-02-24T17:30:16.894846+0000","last_became_active":"2026-02-24T17:25:36.978414+0000","last_became_peered":"2026-02-24T17:25:36.978414+0000","last_unstale":"2026-02-24T17:30:16.894846+0000","last_undegraded":"2026-02-24T17:30:16.894846+0000","last_fullsized":"2026-02-24T17:30:16.894846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:32:38.297792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816104+0000","last_change":"2026-02-24T17:25:36.967706+0000","last_active":"2026-02-24T17:30:16.816104+0000","last_peered":"2026-02-24T17:30:16.816104+0000","last_clean":"2026-02-24T17:30:16.816104+0000","last_became_active":"2026-02-24T17:25:36.967440+0000","last_became_peered":"2026-02-24T17:25:36.967440+0000","last_unstale":"2026-02-24T17:30:16.816104+0000","last_undegraded":"2026-02-24T17:30:16.816104+0000","last_fullsized":"2026-02-24T17:30:16.816104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:46:54.102811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.898865+0000","last_change":"2026-02-24T17:25:36.929256+0000","last_active":"2026-02-24T17:30:16.898865+0000","last_peered":"2026-02-24T17:30:16.898865+0000","last_clean":"2026-02-24T17:30:16.898865+0000","last_became_active":"2026-02-24T17:25:36.927701+0000","last_became_peered":"2026-02-24T17:25:36.927701+0000","last_unstale":"2026-02-24T17:30:16.898865+0000","last_undegraded":"2026-02-24T17:30:16.898865+0000","last_fullsized":"2026-02-24T17:30:16.898865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:24:25.599720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":557,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820632+0000","last_change":"2026-02-24T17:25:36.960677+0000","last_active":"2026-02-24T17:30:16.820632+0000","last_peered":"2026-02-24T17:30:16.820632+0000","last_clean":"2026-02-24T17:30:16.820632+0000","last_became_active":"2026-02-24T17:25:36.959978+0000","last_became_peered":"2026-02-24T17:25:36.959978+0000","last_unstale":"2026-02-24T17:30:16.820632+0000","last_undegraded":"2026-02-24T17:30:16.820632+0000","last_fullsized":"2026-02-24T17:30:16.820632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:44:53.723705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814494+0000","last_change":"2026-02-24T17:25:36.948273+0000","last_active":"2026-02-24T17:30:16.814494+0000","last_peered":"2026-02-24T17:30:16.814494+0000","last_clean":"2026-02-24T17:30:16.814494+0000","last_became_active":"2026-02-24T17:25:36.947821+0000","last_became_peered":"2026-02-24T17:25:36.947821+0000","last_unstale":"2026-02-24T17:30:16.814494+0000","last_undegraded":"2026-02-24T17:30:16.814494+0000","last_fullsized":"2026-02-24T17:30:16.814494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:29:10.189794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":561,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307910+0000","last_change":"2026-02-24T17:25:36.971834+0000","last_active":"2026-02-24T17:30:16.307910+0000","last_peered":"2026-02-24T17:30:16.307910+0000","last_clean":"2026-02-24T17:30:16.307910+0000","last_became_active":"2026-02-24T17:25:36.971529+0000","last_became_peered":"2026-02-24T17:25:36.971529+0000","last_unstale":"2026-02-24T17:30:16.307910+0000","last_undegraded":"2026-02-24T17:30:16.307910+0000","last_fullsized":"2026-02-24T17:30:16.307910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:08:47.585158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307934+0000","last_change":"2026-02-24T17:25:36.971133+0000","last_active":"2026-02-24T17:30:16.307934+0000","last_peered":"2026-02-24T17:30:16.307934+0000","last_clean":"2026-02-24T17:30:16.307934+0000","last_became_active":"2026-02-24T17:25:36.970412+0000","last_became_peered":"2026-02-24T17:25:36.970412+0000","last_unstale":"2026-02-24T17:30:16.307934+0000","last_undegraded":"2026-02-24T17:30:16.307934+0000","last_fullsized":"2026-02-24T17:30:16.307934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:05:49.568228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420711+0000","last_change":"2026-02-24T17:25:37.009919+0000","last_active":"2026-02-24T17:30:16.420711+0000","last_peered":"2026-02-24T17:30:16.420711+0000","last_clean":"2026-02-24T17:30:16.420711+0000","last_became_active":"2026-02-24T17:25:37.003886+0000","last_became_peered":"2026-02-24T17:25:37.003886+0000","last_unstale":"2026-02-24T17:30:16.420711+0000","last_undegraded":"2026-02-24T17:30:16.420711+0000","last_fullsized":"2026-02-24T17:30:16.420711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:18:05.631610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.317722+0000","last_change":"2026-02-24T17:25:36.947604+0000","last_active":"2026-02-24T17:30:16.317722+0000","last_peered":"2026-02-24T17:30:16.317722+0000","last_clean":"2026-02-24T17:30:16.317722+0000","last_became_active":"2026-02-24T17:25:36.942964+0000","last_became_peered":"2026-02-24T17:25:36.942964+0000","last_unstale":"2026-02-24T17:30:16.317722+0000","last_undegraded":"2026-02-24T17:30:16.317722+0000","last_fullsized":"2026-02-24T17:30:16.317722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:12:13.180150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":557,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820192+0000","last_change":"2026-02-24T17:25:36.956652+0000","last_active":"2026-02-24T17:30:16.820192+0000","last_peered":"2026-02-24T17:30:16.820192+0000","last_clean":"2026-02-24T17:30:16.820192+0000","last_became_active":"2026-02-24T17:25:36.953877+0000","last_became_peered":"2026-02-24T17:25:36.953877+0000","last_unstale":"2026-02-24T17:30:16.820192+0000","last_undegraded":"2026-02-24T17:30:16.820192+0000","last_fullsized":"2026-02-24T17:30:16.820192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:17:49.908382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420679+0000","last_change":"2026-02-24T17:25:37.007119+0000","last_active":"2026-02-24T17:30:16.420679+0000","last_peered":"2026-02-24T17:30:16.420679+0000","last_clean":"2026-02-24T17:30:16.420679+0000","last_became_active":"2026-02-24T17:25:36.996719+0000","last_became_peered":"2026-02-24T17:25:36.996719+0000","last_unstale":"2026-02-24T17:30:16.420679+0000","last_undegraded":"2026-02-24T17:30:16.420679+0000","last_fullsized":"2026-02-24T17:30:16.420679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:07:13.684127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307925+0000","last_change":"2026-02-24T17:25:09.854702+0000","last_active":"2026-02-24T17:30:16.307925+0000","last_peered":"2026-02-24T17:30:16.307925+0000","last_clean":"2026-02-24T17:30:16.307925+0000","last_became_active":"2026-02-24T17:25:08.378421+0000","last_became_peered":"2026-02-24T17:25:08.378421+0000","last_unstale":"2026-02-24T17:30:16.307925+0000","last_undegraded":"2026-02-24T17:30:16.307925+0000","last_fullsized":"2026-02-24T17:30:16.307925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:44.939627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816773+0000","last_change":"2026-02-24T17:25:36.961132+0000","last_active":"2026-02-24T17:30:16.816773+0000","last_peered":"2026-02-24T17:30:16.816773+0000","last_clean":"2026-02-24T17:30:16.816773+0000","last_became_active":"2026-02-24T17:25:36.959088+0000","last_became_peered":"2026-02-24T17:25:36.959088+0000","last_unstale":"2026-02-24T17:30:16.816773+0000","last_undegraded":"2026-02-24T17:30:16.816773+0000","last_fullsized":"2026-02-24T17:30:16.816773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:49:13.731672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":580,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814870+0000","last_change":"2026-02-24T17:25:10.079278+0000","last_active":"2026-02-24T17:30:16.814870+0000","last_peered":"2026-02-24T17:30:16.814870+0000","last_clean":"2026-02-24T17:30:16.814870+0000","last_became_active":"2026-02-24T17:25:07.858311+0000","last_became_peered":"2026-02-24T17:25:07.858311+0000","last_unstale":"2026-02-24T17:30:16.814870+0000","last_undegraded":"2026-02-24T17:30:16.814870+0000","last_fullsized":"2026-02-24T17:30:16.814870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:29:45.741836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030397399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816056+0000","last_change":"2026-02-24T17:25:36.951453+0000","last_active":"2026-02-24T17:30:16.816056+0000","last_peered":"2026-02-24T17:30:16.816056+0000","last_clean":"2026-02-24T17:30:16.816056+0000","last_became_active":"2026-02-24T17:25:36.949632+0000","last_became_peered":"2026-02-24T17:25:36.949632+0000","last_unstale":"2026-02-24T17:30:16.816056+0000","last_undegraded":"2026-02-24T17:30:16.816056+0000","last_fullsized":"2026-02-24T17:30:16.816056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:29:49.423443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":575,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.305860+0000","last_change":"2026-02-24T17:25:10.081728+0000","last_active":"2026-02-24T17:30:16.305860+0000","last_peered":"2026-02-24T17:30:16.305860+0000","last_clean":"2026-02-24T17:30:16.305860+0000","last_became_active":"2026-02-24T17:25:08.084075+0000","last_became_peered":"2026-02-24T17:25:08.084075+0000","last_unstale":"2026-02-24T17:30:16.305860+0000","last_undegraded":"2026-02-24T17:30:16.305860+0000","last_fullsized":"2026-02-24T17:30:16.305860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:51:08.211087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000244684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816505+0000","last_change":"2026-02-24T17:25:36.950428+0000","last_active":"2026-02-24T17:30:16.816505+0000","last_peered":"2026-02-24T17:30:16.816505+0000","last_clean":"2026-02-24T17:30:16.816505+0000","last_became_active":"2026-02-24T17:25:36.941218+0000","last_became_peered":"2026-02-24T17:25:36.941218+0000","last_unstale":"2026-02-24T17:30:16.816505+0000","last_undegraded":"2026-02-24T17:30:16.816505+0000","last_fullsized":"2026-02-24T17:30:16.816505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:09:01.212669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816182+0000","last_change":"2026-02-24T17:25:10.079275+0000","last_active":"2026-02-24T17:30:16.816182+0000","last_peered":"2026-02-24T17:30:16.816182+0000","last_clean":"2026-02-24T17:30:16.816182+0000","last_became_active":"2026-02-24T17:25:07.858281+0000","last_became_peered":"2026-02-24T17:25:07.858281+0000","last_unstale":"2026-02-24T17:30:16.816182+0000","last_undegraded":"2026-02-24T17:30:16.816182+0000","last_fullsized":"2026-02-24T17:30:16.816182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:14.965746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028402800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":560,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.899720+0000","last_change":"2026-02-24T17:25:36.944241+0000","last_active":"2026-02-24T17:30:16.899720+0000","last_peered":"2026-02-24T17:30:16.899720+0000","last_clean":"2026-02-24T17:30:16.899720+0000","last_became_active":"2026-02-24T17:25:36.943923+0000","last_became_peered":"2026-02-24T17:25:36.943923+0000","last_unstale":"2026-02-24T17:30:16.899720+0000","last_undegraded":"2026-02-24T17:30:16.899720+0000","last_fullsized":"2026-02-24T17:30:16.899720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:26.543240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":579,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307888+0000","last_change":"2026-02-24T17:25:09.855093+0000","last_active":"2026-02-24T17:30:16.307888+0000","last_peered":"2026-02-24T17:30:16.307888+0000","last_clean":"2026-02-24T17:30:16.307888+0000","last_became_active":"2026-02-24T17:25:08.074872+0000","last_became_peered":"2026-02-24T17:25:08.074872+0000","last_unstale":"2026-02-24T17:30:16.307888+0000","last_undegraded":"2026-02-24T17:30:16.307888+0000","last_fullsized":"2026-02-24T17:30:16.307888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:30:27.324702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089238299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":558,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820494+0000","last_change":"2026-02-24T17:25:36.948717+0000","last_active":"2026-02-24T17:30:16.820494+0000","last_peered":"2026-02-24T17:30:16.820494+0000","last_clean":"2026-02-24T17:30:16.820494+0000","last_became_active":"2026-02-24T17:25:36.947822+0000","last_became_peered":"2026-02-24T17:25:36.947822+0000","last_unstale":"2026-02-24T17:30:16.820494+0000","last_undegraded":"2026-02-24T17:30:16.820494+0000","last_fullsized":"2026-02-24T17:30:16.820494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:21:50.762760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303454+0000","last_change":"2026-02-24T17:25:10.079008+0000","last_active":"2026-02-24T17:30:16.303454+0000","last_peered":"2026-02-24T17:30:16.303454+0000","last_clean":"2026-02-24T17:30:16.303454+0000","last_became_active":"2026-02-24T17:25:07.860331+0000","last_became_peered":"2026-02-24T17:25:07.860331+0000","last_unstale":"2026-02-24T17:30:16.303454+0000","last_undegraded":"2026-02-24T17:30:16.303454+0000","last_fullsized":"2026-02-24T17:30:16.303454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:34:57.054779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023849400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420746+0000","last_change":"2026-02-24T17:25:36.995572+0000","last_active":"2026-02-24T17:30:16.420746+0000","last_peered":"2026-02-24T17:30:16.420746+0000","last_clean":"2026-02-24T17:30:16.420746+0000","last_became_active":"2026-02-24T17:25:36.988342+0000","last_became_peered":"2026-02-24T17:25:36.988342+0000","last_unstale":"2026-02-24T17:30:16.420746+0000","last_undegraded":"2026-02-24T17:30:16.420746+0000","last_fullsized":"2026-02-24T17:30:16.420746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:49.223919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307719+0000","last_change":"2026-02-24T17:25:09.854861+0000","last_active":"2026-02-24T17:30:16.307719+0000","last_peered":"2026-02-24T17:30:16.307719+0000","last_clean":"2026-02-24T17:30:16.307719+0000","last_became_active":"2026-02-24T17:25:08.184697+0000","last_became_peered":"2026-02-24T17:25:08.184697+0000","last_unstale":"2026-02-24T17:30:16.307719+0000","last_undegraded":"2026-02-24T17:30:16.307719+0000","last_fullsized":"2026-02-24T17:30:16.307719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:43:33.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064636800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420858+0000","last_change":"2026-02-24T17:25:37.008582+0000","last_active":"2026-02-24T17:30:16.420858+0000","last_peered":"2026-02-24T17:30:16.420858+0000","last_clean":"2026-02-24T17:30:16.420858+0000","last_became_active":"2026-02-24T17:25:36.995692+0000","last_became_peered":"2026-02-24T17:25:36.995692+0000","last_unstale":"2026-02-24T17:30:16.420858+0000","last_undegraded":"2026-02-24T17:30:16.420858+0000","last_fullsized":"2026-02-24T17:30:16.420858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:44:14.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":578,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303566+0000","last_change":"2026-02-24T17:25:10.079028+0000","last_active":"2026-02-24T17:30:16.303566+0000","last_peered":"2026-02-24T17:30:16.303566+0000","last_clean":"2026-02-24T17:30:16.303566+0000","last_became_active":"2026-02-24T17:25:08.090187+0000","last_became_peered":"2026-02-24T17:25:08.090187+0000","last_unstale":"2026-02-24T17:30:16.303566+0000","last_undegraded":"2026-02-24T17:30:16.303566+0000","last_fullsized":"2026-02-24T17:30:16.303566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:14:10.801138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024157000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"25'192","reported_seq":803,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816341+0000","last_change":"2026-02-24T17:25:04.114588+0000","last_active":"2026-02-24T17:30:16.816341+0000","last_peered":"2026-02-24T17:30:16.816341+0000","last_clean":"2026-02-24T17:30:16.816341+0000","last_became_active":"2026-02-24T17:25:04.113696+0000","last_became_peered":"2026-02-24T17:25:04.113696+0000","last_unstale":"2026-02-24T17:30:16.816341+0000","last_undegraded":"2026-02-24T17:30:16.816341+0000","last_fullsized":"2026-02-24T17:30:16.816341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_clean_scrub_stamp":"2026-02-24T17:25:02.798744+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:55:22.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816130+0000","last_change":"2026-02-24T17:25:36.951158+0000","last_active":"2026-02-24T17:30:16.816130+0000","last_peered":"2026-02-24T17:30:16.816130+0000","last_clean":"2026-02-24T17:30:16.816130+0000","last_became_active":"2026-02-24T17:25:36.949323+0000","last_became_peered":"2026-02-24T17:25:36.949323+0000","last_unstale":"2026-02-24T17:30:16.816130+0000","last_undegraded":"2026-02-24T17:30:16.816130+0000","last_fullsized":"2026-02-24T17:30:16.816130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:00:33.896080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":558,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:17.105993+0000","last_change":"2026-02-24T17:25:36.939870+0000","last_active":"2026-02-24T17:30:17.105993+0000","last_peered":"2026-02-24T17:30:17.105993+0000","last_clean":"2026-02-24T17:30:17.105993+0000","last_became_active":"2026-02-24T17:25:36.939263+0000","last_became_peered":"2026-02-24T17:25:36.939263+0000","last_unstale":"2026-02-24T17:30:17.105993+0000","last_undegraded":"2026-02-24T17:30:17.105993+0000","last_fullsized":"2026-02-24T17:30:17.105993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:00:46.910276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816440+0000","last_change":"2026-02-24T17:25:36.938520+0000","last_active":"2026-02-24T17:30:16.816440+0000","last_peered":"2026-02-24T17:30:16.816440+0000","last_clean":"2026-02-24T17:30:16.816440+0000","last_became_active":"2026-02-24T17:25:36.936185+0000","last_became_peered":"2026-02-24T17:25:36.936185+0000","last_unstale":"2026-02-24T17:30:16.816440+0000","last_undegraded":"2026-02-24T17:30:16.816440+0000","last_fullsized":"2026-02-24T17:30:16.816440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:09:43.790677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303659+0000","last_change":"2026-02-24T17:25:36.953789+0000","last_active":"2026-02-24T17:30:16.303659+0000","last_peered":"2026-02-24T17:30:16.303659+0000","last_clean":"2026-02-24T17:30:16.303659+0000","last_became_active":"2026-02-24T17:25:36.949495+0000","last_became_peered":"2026-02-24T17:25:36.949495+0000","last_unstale":"2026-02-24T17:30:16.303659+0000","last_undegraded":"2026-02-24T17:30:16.303659+0000","last_fullsized":"2026-02-24T17:30:16.303659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:10.043156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816224+0000","last_change":"2026-02-24T17:25:36.988365+0000","last_active":"2026-02-24T17:30:16.816224+0000","last_peered":"2026-02-24T17:30:16.816224+0000","last_clean":"2026-02-24T17:30:16.816224+0000","last_became_active":"2026-02-24T17:25:36.988207+0000","last_became_peered":"2026-02-24T17:25:36.988207+0000","last_unstale":"2026-02-24T17:30:16.816224+0000","last_undegraded":"2026-02-24T17:30:16.816224+0000","last_fullsized":"2026-02-24T17:30:16.816224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:44:31.138787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420667+0000","last_change":"2026-02-24T17:25:37.008436+0000","last_active":"2026-02-24T17:30:16.420667+0000","last_peered":"2026-02-24T17:30:16.420667+0000","last_clean":"2026-02-24T17:30:16.420667+0000","last_became_active":"2026-02-24T17:25:37.002254+0000","last_became_peered":"2026-02-24T17:25:37.002254+0000","last_unstale":"2026-02-24T17:30:16.420667+0000","last_undegraded":"2026-02-24T17:30:16.420667+0000","last_fullsized":"2026-02-24T17:30:16.420667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:10:08.553481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"32'11","reported_seq":584,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:17.105921+0000","last_change":"2026-02-24T17:25:36.955772+0000","last_active":"2026-02-24T17:30:17.105921+0000","last_peered":"2026-02-24T17:30:17.105921+0000","last_clean":"2026-02-24T17:30:17.105921+0000","last_became_active":"2026-02-24T17:25:36.954370+0000","last_became_peered":"2026-02-24T17:25:36.954370+0000","last_unstale":"2026-02-24T17:30:17.105921+0000","last_undegraded":"2026-02-24T17:30:17.105921+0000","last_fullsized":"2026-02-24T17:30:17.105921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:00:02.410830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816819+0000","last_change":"2026-02-24T17:25:36.967349+0000","last_active":"2026-02-24T17:30:16.816819+0000","last_peered":"2026-02-24T17:30:16.816819+0000","last_clean":"2026-02-24T17:30:16.816819+0000","last_became_active":"2026-02-24T17:25:36.967164+0000","last_became_peered":"2026-02-24T17:25:36.967164+0000","last_unstale":"2026-02-24T17:30:16.816819+0000","last_undegraded":"2026-02-24T17:30:16.816819+0000","last_fullsized":"2026-02-24T17:30:16.816819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:24:47.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":561,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.603289+0000","last_change":"2026-02-24T17:25:36.943423+0000","last_active":"2026-02-24T17:30:16.603289+0000","last_peered":"2026-02-24T17:30:16.603289+0000","last_clean":"2026-02-24T17:30:16.603289+0000","last_became_active":"2026-02-24T17:25:36.941089+0000","last_became_peered":"2026-02-24T17:25:36.941089+0000","last_unstale":"2026-02-24T17:30:16.603289+0000","last_undegraded":"2026-02-24T17:30:16.603289+0000","last_fullsized":"2026-02-24T17:30:16.603289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:21:37.674638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816167+0000","last_change":"2026-02-24T17:25:36.939435+0000","last_active":"2026-02-24T17:30:16.816167+0000","last_peered":"2026-02-24T17:30:16.816167+0000","last_clean":"2026-02-24T17:30:16.816167+0000","last_became_active":"2026-02-24T17:25:36.938491+0000","last_became_peered":"2026-02-24T17:25:36.938491+0000","last_unstale":"2026-02-24T17:30:16.816167+0000","last_undegraded":"2026-02-24T17:30:16.816167+0000","last_fullsized":"2026-02-24T17:30:16.816167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:36:23.352712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":560,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.603937+0000","last_change":"2026-02-24T17:25:36.938161+0000","last_active":"2026-02-24T17:30:16.603937+0000","last_peered":"2026-02-24T17:30:16.603937+0000","last_clean":"2026-02-24T17:30:16.603937+0000","last_became_active":"2026-02-24T17:25:36.937025+0000","last_became_peered":"2026-02-24T17:25:36.937025+0000","last_unstale":"2026-02-24T17:30:16.603937+0000","last_undegraded":"2026-02-24T17:30:16.603937+0000","last_fullsized":"2026-02-24T17:30:16.603937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:40:14.141988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420968+0000","last_change":"2026-02-24T17:25:36.988471+0000","last_active":"2026-02-24T17:30:16.420968+0000","last_peered":"2026-02-24T17:30:16.420968+0000","last_clean":"2026-02-24T17:30:16.420968+0000","last_became_active":"2026-02-24T17:25:36.985324+0000","last_became_peered":"2026-02-24T17:25:36.985324+0000","last_unstale":"2026-02-24T17:30:16.420968+0000","last_undegraded":"2026-02-24T17:30:16.420968+0000","last_fullsized":"2026-02-24T17:30:16.420968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:56:48.935815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.899835+0000","last_change":"2026-02-24T17:25:36.928873+0000","last_active":"2026-02-24T17:30:16.899835+0000","last_peered":"2026-02-24T17:30:16.899835+0000","last_clean":"2026-02-24T17:30:16.899835+0000","last_became_active":"2026-02-24T17:25:36.928525+0000","last_became_peered":"2026-02-24T17:25:36.928525+0000","last_unstale":"2026-02-24T17:30:16.899835+0000","last_undegraded":"2026-02-24T17:30:16.899835+0000","last_fullsized":"2026-02-24T17:30:16.899835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:02:20.618977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":2,"acting":2,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":2,"up_from":21,"seq":90194313282,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3248436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189403,"internal_metadata":27401253},"hb_peers":[0,1,3,4,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":21,"seq":90194313283,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2937,"kb_used_meta":24006,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3252877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3007961,"internal_metadata":24582695},"hb_peers":[0,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2993,"kb_used_meta":23950,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3267610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3065731,"internal_metadata":24524925},"hb_peers":[0,4,5,6,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313284,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":5412,"kb_used_omap":2970,"kb_used_meta":23973,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":5541888,"data_stored":3259528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3041792,"internal_metadata":24548864},"hb_peers":[1,3,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313283,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":5444,"kb_used_omap":5476,"kb_used_meta":21467,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":5574656,"data_stored":3262696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5607519,"internal_metadata":21983137},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313282,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":5400,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":5529600,"data_stored":3255127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[0,2,3,4,6,7,9,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3264371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3063988,"internal_metadata":24526668},"hb_peers":[0,2,4,5,7,8,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313282,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":183,"kb_used_meta":26760,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3244929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187407,"internal_metadata":27403249},"hb_peers":[1,3,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313283,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":5976,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":6119424,"data_stored":3835511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":192289,"internal_metadata":27398367},"hb_peers":[2,4,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":6020,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":6164480,"data_stored":3841297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188812,"internal_metadata":27401844},"hb_peers":[0,1,3,5,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":5468,"kb_used_omap":188,"kb_used_meta":26755,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":5599232,"data_stored":3272622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":193209,"internal_metadata":27397447},"hb_peers":[0,1,6,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":5448,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":5578752,"data_stored":3262562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":191672,"internal_metadata":27398984},"hb_peers":[0,3,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":5404,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":5533696,"data_stored":3252627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[2,4,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313282,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":5436,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":5566464,"data_stored":3261683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3064212,"internal_metadata":24526444},"hb_peers":[0,4,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313282,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2994,"kb_used_meta":23949,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3265804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3066142,"internal_metadata":24524514},"hb_peers":[0,2,3,4,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3257291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190563,"internal_metadata":27400093},"hb_peers":[1,3,4,6,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T17:30:26.467 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T17:30:26.467 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T17:30:26.535 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cb0505640 1 Processor -- start 2026-02-24T17:30:26.536 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cb0505640 1 -- start start 2026-02-24T17:30:26.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cb0505640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f6ca80b2500 0x7f6ca80b28d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cb0505640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f6ca8168840 0x7f6ca8164910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cb0505640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca81651b0 con 0x7f6ca80b4320 2026-02-24T17:30:26.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cb0505640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca8165490 con 0x7f6ca80b2500 2026-02-24T17:30:26.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cb0505640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca8165770 con 0x7f6ca8168840 2026-02-24T17:30:26.539 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6caea7b640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f6ca80b4320 0x7f6ca80b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34414/0 (socket says 10.20.193.40:34414) 2026-02-24T17:30:26.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cae27a640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f6ca80b2500 0x7f6ca80b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6caea7b640 1 -- 10.20.193.40:0/2585663574 learned_addr learned my addr 10.20.193.40:0/2585663574 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:26.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cada79640 1 --2- 10.20.193.40:0/2585663574 >> v2:10.20.193.109:3300/0 conn(0x7f6ca8168840 0x7f6ca8164910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cad278640 1 -- 10.20.193.40:0/2585663574 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258816603 0 0) 0x7f6ca81651b0 con 0x7f6ca80b4320 2026-02-24T17:30:26.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cad278640 1 -- 10.20.193.40:0/2585663574 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c90003620 con 0x7f6ca80b4320 2026-02-24T17:30:26.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cae27a640 1 -- 10.20.193.40:0/2585663574 >> v2:10.20.193.109:3300/0 conn(0x7f6ca8168840 msgr2=0x7f6ca8164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:26.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cae27a640 1 --2- 10.20.193.40:0/2585663574 >> v2:10.20.193.109:3300/0 conn(0x7f6ca8168840 0x7f6ca8164910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.540 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cae27a640 1 -- 10.20.193.40:0/2585663574 >> v1:10.20.193.40:6789/0 conn(0x7f6ca80b4320 legacy=0x7f6ca80b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.535+0000 7f6cae27a640 1 -- 10.20.193.40:0/2585663574 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca80b3560 con 0x7f6ca80b2500 2026-02-24T17:30:26.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cae27a640 1 --2- 10.20.193.40:0/2585663574 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca80b2500 0x7f6ca80b28d0 secure :-1 s=READY pgs=5148 gs=2 cs=0 l=1 c_cookie=15590237015087434961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca805b3b0 tx=0x7f6c9801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85ba5f6f06eccd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cad278640 1 -- 10.20.193.40:0/2585663574 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c980b2070 con 0x7f6ca80b2500 2026-02-24T17:30:26.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cad278640 1 -- 10.20.193.40:0/2585663574 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c980ad6a0 con 0x7f6ca80b2500 2026-02-24T17:30:26.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cad278640 1 -- 10.20.193.40:0/2585663574 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c980ada90 con 0x7f6ca80b2500 2026-02-24T17:30:26.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- 10.20.193.40:0/2585663574 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca80b2500 msgr2=0x7f6ca80b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 --2- 10.20.193.40:0/2585663574 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca80b2500 0x7f6ca80b28d0 secure :-1 s=READY pgs=5148 gs=2 cs=0 l=1 c_cookie=15590237015087434961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca805b3b0 tx=0x7f6c9801c490 comp rx=0 tx=0).stop 2026-02-24T17:30:26.541 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- 10.20.193.40:0/2585663574 shutdown_connections 2026-02-24T17:30:26.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 --2- 10.20.193.40:0/2585663574 >> v2:10.20.193.109:3300/0 conn(0x7f6ca8168840 0x7f6ca8164910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 --2- 10.20.193.40:0/2585663574 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca80b2500 0x7f6ca80b28d0 unknown :-1 s=CLOSED pgs=5148 gs=2 cs=0 l=1 c_cookie=15590237015087434961 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- 10.20.193.40:0/2585663574 >> 10.20.193.40:0/2585663574 conn(0x7f6ca80b8fd0 msgr2=0x7f6ca80b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:26.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- 10.20.193.40:0/2585663574 shutdown_connections 2026-02-24T17:30:26.542 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- 10.20.193.40:0/2585663574 wait complete. 2026-02-24T17:30:26.545 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 librados: starting msgr at 2026-02-24T17:30:26.545 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 librados: starting objecter 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 Processor -- start 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- start start 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 librados: setting wanted keys 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 librados: calling monclient init 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ca80b2500 0x7f6ca8166b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ca80b4320 0x7f6ca815c2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca8168840 0x7f6ca80affa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca80567f0 con 0x7f6ca8168840 2026-02-24T17:30:26.546 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8168c40 con 0x7f6ca80b2500 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca817a330 con 0x7f6ca80b4320 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca8168840 0x7f6ca80affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca8168840 0x7f6ca80affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57454/0 (socket says 10.20.193.40:57454) 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 -- 10.20.193.40:0/3454383350 learned_addr learned my addr 10.20.193.40:0/3454383350 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cae27a640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ca80b2500 0x7f6ca8166b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cada79640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ca80b4320 0x7f6ca815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 -- 10.20.193.40:0/3454383350 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ca80b4320 msgr2=0x7f6ca815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ca80b4320 0x7f6ca815c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 -- 10.20.193.40:0/3454383350 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ca80b2500 msgr2=0x7f6ca8166b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.547 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ca80b2500 0x7f6ca8166b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 -- 10.20.193.40:0/3454383350 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca8167090 con 0x7f6ca8168840 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6caea7b640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca8168840 0x7f6ca80affa0 secure :-1 s=READY pgs=5149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca400da70 tx=0x7f6ca400df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6c8effd640 10 client.?.objecter ms_handle_connect 0x7f6ca8168840 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6c8effd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6c8effd640 1 -- 10.20.193.40:0/3454383350 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca4018070 con 0x7f6ca8168840 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6c8effd640 1 -- 10.20.193.40:0/3454383350 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca400bad0 con 0x7f6ca8168840 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca817d6a0 con 0x7f6ca8168840 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6c8effd640 1 -- 10.20.193.40:0/3454383350 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca4013400 con 0x7f6ca8168840 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 10 client.25308.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca8179850 con 0x7f6ca8168840 2026-02-24T17:30:26.548 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.539+0000 7f6cb0505640 1 librados: init done 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca81651b0 con 0x7f6ca8168840 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 1 -- 10.20.193.40:0/3454383350 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f6ca401d440 con 0x7f6ca8168840 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 1 --2- 10.20.193.40:0/3454383350 >> v2:10.20.193.120:6800/397309233 conn(0x7f6c780740f0 0x7f6c780945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 1 -- 10.20.193.40:0/3454383350 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f6ca4097500 con 0x7f6ca8168840 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 10 client.25308.objecter ms_dispatch2 0x7f6ca8000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 3 client.25308.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 3 client.25308.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 20 client.25308.objecter dump_active .. 0 homeless 2026-02-24T17:30:26.549 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6cae27a640 1 --2- 10.20.193.40:0/3454383350 >> v2:10.20.193.120:6800/397309233 conn(0x7f6c780740f0 0x7f6c780945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.550 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6cae27a640 1 --2- 10.20.193.40:0/3454383350 >> v2:10.20.193.120:6800/397309233 conn(0x7f6c780740f0 0x7f6c780945a0 secure :-1 s=READY pgs=2229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9801c4d0 tx=0x7f6c980af040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.550 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 10 client.25308.objecter ms_handle_connect 0x7f6c780740f0 2026-02-24T17:30:26.550 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.543+0000 7f6c8effd640 1 -- 10.20.193.40:0/3454383350 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f6ca4022070 con 0x7f6ca8168840 2026-02-24T17:30:26.632 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.631+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ca803b110 con 0x7f6c780740f0 2026-02-24T17:30:26.633 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6c8effd640 1 -- 10.20.193.40:0/3454383350 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+124926 (secure 0 0 0) 0x7f6c980040c0 con 0x7f6c780740f0 2026-02-24T17:30:26.634 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:30:26.634 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 10 librados: watch_flush enter 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 10 librados: watch_flush exit 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 20 client.25308.objecter shutdown clearing up homeless session... 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 10 client.25308.objecter successfully canceled tick 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 >> v2:10.20.193.120:6800/397309233 conn(0x7f6c780740f0 msgr2=0x7f6c780945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 --2- 10.20.193.40:0/3454383350 >> v2:10.20.193.120:6800/397309233 conn(0x7f6c780740f0 0x7f6c780945a0 secure :-1 s=READY pgs=2229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9801c4d0 tx=0x7f6c980af040 comp rx=0 tx=0).stop 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca8168840 msgr2=0x7f6ca80affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca8168840 0x7f6ca80affa0 secure :-1 s=READY pgs=5149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca400da70 tx=0x7f6ca400df30 comp rx=0 tx=0).stop 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 shutdown_connections 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 --2- 10.20.193.40:0/3454383350 >> v2:10.20.193.120:6800/397309233 conn(0x7f6c780740f0 0x7f6c780945a0 unknown :-1 s=CLOSED pgs=2229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ca8168840 0x7f6ca80affa0 unknown :-1 s=CLOSED pgs=5149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ca80b4320 0x7f6ca815c2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 --2- 10.20.193.40:0/3454383350 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ca80b2500 0x7f6ca8166b50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 >> 10.20.193.40:0/3454383350 conn(0x7f6ca80b8fd0 msgr2=0x7f6ca80b93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 shutdown_connections 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 -- 10.20.193.40:0/3454383350 wait complete. 2026-02-24T17:30:26.635 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.635+0000 7f6cb0505640 1 librados: shutdown 2026-02-24T17:30:26.644 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":465,"stamp":"2026-02-24T17:30:25.916166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":246,"num_write_kb":4773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":519372,"kb_used_data":88012,"kb_used_omap":25027,"kb_used_meta":406076,"kb_avail":1509430068,"statfs":{"total":1546188226560,"available":1545656389632,"internally_reserved":0,"allocated":90124288,"data_stored":53304971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25628640,"internal_metadata":415821856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001337"},"pg_stats":[{"pgid":"15.13","version":"0'0","reported_seq":565,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814772+0000","last_change":"2026-02-24T17:25:36.929977+0000","last_active":"2026-02-24T17:30:16.814772+0000","last_peered":"2026-02-24T17:30:16.814772+0000","last_clean":"2026-02-24T17:30:16.814772+0000","last_became_active":"2026-02-24T17:25:36.924928+0000","last_became_peered":"2026-02-24T17:25:36.924928+0000","last_unstale":"2026-02-24T17:30:16.814772+0000","last_undegraded":"2026-02-24T17:30:16.814772+0000","last_fullsized":"2026-02-24T17:30:16.814772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:49.788613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.894846+0000","last_change":"2026-02-24T17:25:36.978515+0000","last_active":"2026-02-24T17:30:16.894846+0000","last_peered":"2026-02-24T17:30:16.894846+0000","last_clean":"2026-02-24T17:30:16.894846+0000","last_became_active":"2026-02-24T17:25:36.978414+0000","last_became_peered":"2026-02-24T17:25:36.978414+0000","last_unstale":"2026-02-24T17:30:16.894846+0000","last_undegraded":"2026-02-24T17:30:16.894846+0000","last_fullsized":"2026-02-24T17:30:16.894846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:32:38.297792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816104+0000","last_change":"2026-02-24T17:25:36.967706+0000","last_active":"2026-02-24T17:30:16.816104+0000","last_peered":"2026-02-24T17:30:16.816104+0000","last_clean":"2026-02-24T17:30:16.816104+0000","last_became_active":"2026-02-24T17:25:36.967440+0000","last_became_peered":"2026-02-24T17:25:36.967440+0000","last_unstale":"2026-02-24T17:30:16.816104+0000","last_undegraded":"2026-02-24T17:30:16.816104+0000","last_fullsized":"2026-02-24T17:30:16.816104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:46:54.102811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.898865+0000","last_change":"2026-02-24T17:25:36.929256+0000","last_active":"2026-02-24T17:30:16.898865+0000","last_peered":"2026-02-24T17:30:16.898865+0000","last_clean":"2026-02-24T17:30:16.898865+0000","last_became_active":"2026-02-24T17:25:36.927701+0000","last_became_peered":"2026-02-24T17:25:36.927701+0000","last_unstale":"2026-02-24T17:30:16.898865+0000","last_undegraded":"2026-02-24T17:30:16.898865+0000","last_fullsized":"2026-02-24T17:30:16.898865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:24:25.599720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":557,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820632+0000","last_change":"2026-02-24T17:25:36.960677+0000","last_active":"2026-02-24T17:30:16.820632+0000","last_peered":"2026-02-24T17:30:16.820632+0000","last_clean":"2026-02-24T17:30:16.820632+0000","last_became_active":"2026-02-24T17:25:36.959978+0000","last_became_peered":"2026-02-24T17:25:36.959978+0000","last_unstale":"2026-02-24T17:30:16.820632+0000","last_undegraded":"2026-02-24T17:30:16.820632+0000","last_fullsized":"2026-02-24T17:30:16.820632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:44:53.723705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814494+0000","last_change":"2026-02-24T17:25:36.948273+0000","last_active":"2026-02-24T17:30:16.814494+0000","last_peered":"2026-02-24T17:30:16.814494+0000","last_clean":"2026-02-24T17:30:16.814494+0000","last_became_active":"2026-02-24T17:25:36.947821+0000","last_became_peered":"2026-02-24T17:25:36.947821+0000","last_unstale":"2026-02-24T17:30:16.814494+0000","last_undegraded":"2026-02-24T17:30:16.814494+0000","last_fullsized":"2026-02-24T17:30:16.814494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:29:10.189794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":561,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307910+0000","last_change":"2026-02-24T17:25:36.971834+0000","last_active":"2026-02-24T17:30:16.307910+0000","last_peered":"2026-02-24T17:30:16.307910+0000","last_clean":"2026-02-24T17:30:16.307910+0000","last_became_active":"2026-02-24T17:25:36.971529+0000","last_became_peered":"2026-02-24T17:25:36.971529+0000","last_unstale":"2026-02-24T17:30:16.307910+0000","last_undegraded":"2026-02-24T17:30:16.307910+0000","last_fullsized":"2026-02-24T17:30:16.307910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:08:47.585158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307934+0000","last_change":"2026-02-24T17:25:36.971133+0000","last_active":"2026-02-24T17:30:16.307934+0000","last_peered":"2026-02-24T17:30:16.307934+0000","last_clean":"2026-02-24T17:30:16.307934+0000","last_became_active":"2026-02-24T17:25:36.970412+0000","last_became_peered":"2026-02-24T17:25:36.970412+0000","last_unstale":"2026-02-24T17:30:16.307934+0000","last_undegraded":"2026-02-24T17:30:16.307934+0000","last_fullsized":"2026-02-24T17:30:16.307934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:05:49.568228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420711+0000","last_change":"2026-02-24T17:25:37.009919+0000","last_active":"2026-02-24T17:30:16.420711+0000","last_peered":"2026-02-24T17:30:16.420711+0000","last_clean":"2026-02-24T17:30:16.420711+0000","last_became_active":"2026-02-24T17:25:37.003886+0000","last_became_peered":"2026-02-24T17:25:37.003886+0000","last_unstale":"2026-02-24T17:30:16.420711+0000","last_undegraded":"2026-02-24T17:30:16.420711+0000","last_fullsized":"2026-02-24T17:30:16.420711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:18:05.631610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.317722+0000","last_change":"2026-02-24T17:25:36.947604+0000","last_active":"2026-02-24T17:30:16.317722+0000","last_peered":"2026-02-24T17:30:16.317722+0000","last_clean":"2026-02-24T17:30:16.317722+0000","last_became_active":"2026-02-24T17:25:36.942964+0000","last_became_peered":"2026-02-24T17:25:36.942964+0000","last_unstale":"2026-02-24T17:30:16.317722+0000","last_undegraded":"2026-02-24T17:30:16.317722+0000","last_fullsized":"2026-02-24T17:30:16.317722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:12:13.180150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":557,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820192+0000","last_change":"2026-02-24T17:25:36.956652+0000","last_active":"2026-02-24T17:30:16.820192+0000","last_peered":"2026-02-24T17:30:16.820192+0000","last_clean":"2026-02-24T17:30:16.820192+0000","last_became_active":"2026-02-24T17:25:36.953877+0000","last_became_peered":"2026-02-24T17:25:36.953877+0000","last_unstale":"2026-02-24T17:30:16.820192+0000","last_undegraded":"2026-02-24T17:30:16.820192+0000","last_fullsized":"2026-02-24T17:30:16.820192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:17:49.908382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420679+0000","last_change":"2026-02-24T17:25:37.007119+0000","last_active":"2026-02-24T17:30:16.420679+0000","last_peered":"2026-02-24T17:30:16.420679+0000","last_clean":"2026-02-24T17:30:16.420679+0000","last_became_active":"2026-02-24T17:25:36.996719+0000","last_became_peered":"2026-02-24T17:25:36.996719+0000","last_unstale":"2026-02-24T17:30:16.420679+0000","last_undegraded":"2026-02-24T17:30:16.420679+0000","last_fullsized":"2026-02-24T17:30:16.420679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:07:13.684127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307925+0000","last_change":"2026-02-24T17:25:09.854702+0000","last_active":"2026-02-24T17:30:16.307925+0000","last_peered":"2026-02-24T17:30:16.307925+0000","last_clean":"2026-02-24T17:30:16.307925+0000","last_became_active":"2026-02-24T17:25:08.378421+0000","last_became_peered":"2026-02-24T17:25:08.378421+0000","last_unstale":"2026-02-24T17:30:16.307925+0000","last_undegraded":"2026-02-24T17:30:16.307925+0000","last_fullsized":"2026-02-24T17:30:16.307925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:04:44.939627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816773+0000","last_change":"2026-02-24T17:25:36.961132+0000","last_active":"2026-02-24T17:30:16.816773+0000","last_peered":"2026-02-24T17:30:16.816773+0000","last_clean":"2026-02-24T17:30:16.816773+0000","last_became_active":"2026-02-24T17:25:36.959088+0000","last_became_peered":"2026-02-24T17:25:36.959088+0000","last_unstale":"2026-02-24T17:30:16.816773+0000","last_undegraded":"2026-02-24T17:30:16.816773+0000","last_fullsized":"2026-02-24T17:30:16.816773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:49:13.731672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":580,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814870+0000","last_change":"2026-02-24T17:25:10.079278+0000","last_active":"2026-02-24T17:30:16.814870+0000","last_peered":"2026-02-24T17:30:16.814870+0000","last_clean":"2026-02-24T17:30:16.814870+0000","last_became_active":"2026-02-24T17:25:07.858311+0000","last_became_peered":"2026-02-24T17:25:07.858311+0000","last_unstale":"2026-02-24T17:30:16.814870+0000","last_undegraded":"2026-02-24T17:30:16.814870+0000","last_fullsized":"2026-02-24T17:30:16.814870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:29:45.741836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030397399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816056+0000","last_change":"2026-02-24T17:25:36.951453+0000","last_active":"2026-02-24T17:30:16.816056+0000","last_peered":"2026-02-24T17:30:16.816056+0000","last_clean":"2026-02-24T17:30:16.816056+0000","last_became_active":"2026-02-24T17:25:36.949632+0000","last_became_peered":"2026-02-24T17:25:36.949632+0000","last_unstale":"2026-02-24T17:30:16.816056+0000","last_undegraded":"2026-02-24T17:30:16.816056+0000","last_fullsized":"2026-02-24T17:30:16.816056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:29:49.423443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":575,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.305860+0000","last_change":"2026-02-24T17:25:10.081728+0000","last_active":"2026-02-24T17:30:16.305860+0000","last_peered":"2026-02-24T17:30:16.305860+0000","last_clean":"2026-02-24T17:30:16.305860+0000","last_became_active":"2026-02-24T17:25:08.084075+0000","last_became_peered":"2026-02-24T17:25:08.084075+0000","last_unstale":"2026-02-24T17:30:16.305860+0000","last_undegraded":"2026-02-24T17:30:16.305860+0000","last_fullsized":"2026-02-24T17:30:16.305860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:51:08.211087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000244684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816505+0000","last_change":"2026-02-24T17:25:36.950428+0000","last_active":"2026-02-24T17:30:16.816505+0000","last_peered":"2026-02-24T17:30:16.816505+0000","last_clean":"2026-02-24T17:30:16.816505+0000","last_became_active":"2026-02-24T17:25:36.941218+0000","last_became_peered":"2026-02-24T17:25:36.941218+0000","last_unstale":"2026-02-24T17:30:16.816505+0000","last_undegraded":"2026-02-24T17:30:16.816505+0000","last_fullsized":"2026-02-24T17:30:16.816505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:09:01.212669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816182+0000","last_change":"2026-02-24T17:25:10.079275+0000","last_active":"2026-02-24T17:30:16.816182+0000","last_peered":"2026-02-24T17:30:16.816182+0000","last_clean":"2026-02-24T17:30:16.816182+0000","last_became_active":"2026-02-24T17:25:07.858281+0000","last_became_peered":"2026-02-24T17:25:07.858281+0000","last_unstale":"2026-02-24T17:30:16.816182+0000","last_undegraded":"2026-02-24T17:30:16.816182+0000","last_fullsized":"2026-02-24T17:30:16.816182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:14.965746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028402800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":560,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.899720+0000","last_change":"2026-02-24T17:25:36.944241+0000","last_active":"2026-02-24T17:30:16.899720+0000","last_peered":"2026-02-24T17:30:16.899720+0000","last_clean":"2026-02-24T17:30:16.899720+0000","last_became_active":"2026-02-24T17:25:36.943923+0000","last_became_peered":"2026-02-24T17:25:36.943923+0000","last_unstale":"2026-02-24T17:30:16.899720+0000","last_undegraded":"2026-02-24T17:30:16.899720+0000","last_fullsized":"2026-02-24T17:30:16.899720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:26.543240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":579,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307888+0000","last_change":"2026-02-24T17:25:09.855093+0000","last_active":"2026-02-24T17:30:16.307888+0000","last_peered":"2026-02-24T17:30:16.307888+0000","last_clean":"2026-02-24T17:30:16.307888+0000","last_became_active":"2026-02-24T17:25:08.074872+0000","last_became_peered":"2026-02-24T17:25:08.074872+0000","last_unstale":"2026-02-24T17:30:16.307888+0000","last_undegraded":"2026-02-24T17:30:16.307888+0000","last_fullsized":"2026-02-24T17:30:16.307888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:30:27.324702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089238299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":558,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.820494+0000","last_change":"2026-02-24T17:25:36.948717+0000","last_active":"2026-02-24T17:30:16.820494+0000","last_peered":"2026-02-24T17:30:16.820494+0000","last_clean":"2026-02-24T17:30:16.820494+0000","last_became_active":"2026-02-24T17:25:36.947822+0000","last_became_peered":"2026-02-24T17:25:36.947822+0000","last_unstale":"2026-02-24T17:30:16.820494+0000","last_undegraded":"2026-02-24T17:30:16.820494+0000","last_fullsized":"2026-02-24T17:30:16.820494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:21:50.762760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303454+0000","last_change":"2026-02-24T17:25:10.079008+0000","last_active":"2026-02-24T17:30:16.303454+0000","last_peered":"2026-02-24T17:30:16.303454+0000","last_clean":"2026-02-24T17:30:16.303454+0000","last_became_active":"2026-02-24T17:25:07.860331+0000","last_became_peered":"2026-02-24T17:25:07.860331+0000","last_unstale":"2026-02-24T17:30:16.303454+0000","last_undegraded":"2026-02-24T17:30:16.303454+0000","last_fullsized":"2026-02-24T17:30:16.303454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:34:57.054779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023849400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420746+0000","last_change":"2026-02-24T17:25:36.995572+0000","last_active":"2026-02-24T17:30:16.420746+0000","last_peered":"2026-02-24T17:30:16.420746+0000","last_clean":"2026-02-24T17:30:16.420746+0000","last_became_active":"2026-02-24T17:25:36.988342+0000","last_became_peered":"2026-02-24T17:25:36.988342+0000","last_unstale":"2026-02-24T17:30:16.420746+0000","last_undegraded":"2026-02-24T17:30:16.420746+0000","last_fullsized":"2026-02-24T17:30:16.420746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:49.223919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307719+0000","last_change":"2026-02-24T17:25:09.854861+0000","last_active":"2026-02-24T17:30:16.307719+0000","last_peered":"2026-02-24T17:30:16.307719+0000","last_clean":"2026-02-24T17:30:16.307719+0000","last_became_active":"2026-02-24T17:25:08.184697+0000","last_became_peered":"2026-02-24T17:25:08.184697+0000","last_unstale":"2026-02-24T17:30:16.307719+0000","last_undegraded":"2026-02-24T17:30:16.307719+0000","last_fullsized":"2026-02-24T17:30:16.307719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:43:33.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064636800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420858+0000","last_change":"2026-02-24T17:25:37.008582+0000","last_active":"2026-02-24T17:30:16.420858+0000","last_peered":"2026-02-24T17:30:16.420858+0000","last_clean":"2026-02-24T17:30:16.420858+0000","last_became_active":"2026-02-24T17:25:36.995692+0000","last_became_peered":"2026-02-24T17:25:36.995692+0000","last_unstale":"2026-02-24T17:30:16.420858+0000","last_undegraded":"2026-02-24T17:30:16.420858+0000","last_fullsized":"2026-02-24T17:30:16.420858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:44:14.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":578,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303566+0000","last_change":"2026-02-24T17:25:10.079028+0000","last_active":"2026-02-24T17:30:16.303566+0000","last_peered":"2026-02-24T17:30:16.303566+0000","last_clean":"2026-02-24T17:30:16.303566+0000","last_became_active":"2026-02-24T17:25:08.090187+0000","last_became_peered":"2026-02-24T17:25:08.090187+0000","last_unstale":"2026-02-24T17:30:16.303566+0000","last_undegraded":"2026-02-24T17:30:16.303566+0000","last_fullsized":"2026-02-24T17:30:16.303566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:14:10.801138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024157000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"25'192","reported_seq":803,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816341+0000","last_change":"2026-02-24T17:25:04.114588+0000","last_active":"2026-02-24T17:30:16.816341+0000","last_peered":"2026-02-24T17:30:16.816341+0000","last_clean":"2026-02-24T17:30:16.816341+0000","last_became_active":"2026-02-24T17:25:04.113696+0000","last_became_peered":"2026-02-24T17:25:04.113696+0000","last_unstale":"2026-02-24T17:30:16.816341+0000","last_undegraded":"2026-02-24T17:30:16.816341+0000","last_fullsized":"2026-02-24T17:30:16.816341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:02.798744+0000","last_clean_scrub_stamp":"2026-02-24T17:25:02.798744+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:55:22.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816130+0000","last_change":"2026-02-24T17:25:36.951158+0000","last_active":"2026-02-24T17:30:16.816130+0000","last_peered":"2026-02-24T17:30:16.816130+0000","last_clean":"2026-02-24T17:30:16.816130+0000","last_became_active":"2026-02-24T17:25:36.949323+0000","last_became_peered":"2026-02-24T17:25:36.949323+0000","last_unstale":"2026-02-24T17:30:16.816130+0000","last_undegraded":"2026-02-24T17:30:16.816130+0000","last_fullsized":"2026-02-24T17:30:16.816130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:00:33.896080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":558,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:17.105993+0000","last_change":"2026-02-24T17:25:36.939870+0000","last_active":"2026-02-24T17:30:17.105993+0000","last_peered":"2026-02-24T17:30:17.105993+0000","last_clean":"2026-02-24T17:30:17.105993+0000","last_became_active":"2026-02-24T17:25:36.939263+0000","last_became_peered":"2026-02-24T17:25:36.939263+0000","last_unstale":"2026-02-24T17:30:17.105993+0000","last_undegraded":"2026-02-24T17:30:17.105993+0000","last_fullsized":"2026-02-24T17:30:17.105993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:00:46.910276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816440+0000","last_change":"2026-02-24T17:25:36.938520+0000","last_active":"2026-02-24T17:30:16.816440+0000","last_peered":"2026-02-24T17:30:16.816440+0000","last_clean":"2026-02-24T17:30:16.816440+0000","last_became_active":"2026-02-24T17:25:36.936185+0000","last_became_peered":"2026-02-24T17:25:36.936185+0000","last_unstale":"2026-02-24T17:30:16.816440+0000","last_undegraded":"2026-02-24T17:30:16.816440+0000","last_fullsized":"2026-02-24T17:30:16.816440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:09:43.790677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303659+0000","last_change":"2026-02-24T17:25:36.953789+0000","last_active":"2026-02-24T17:30:16.303659+0000","last_peered":"2026-02-24T17:30:16.303659+0000","last_clean":"2026-02-24T17:30:16.303659+0000","last_became_active":"2026-02-24T17:25:36.949495+0000","last_became_peered":"2026-02-24T17:25:36.949495+0000","last_unstale":"2026-02-24T17:30:16.303659+0000","last_undegraded":"2026-02-24T17:30:16.303659+0000","last_fullsized":"2026-02-24T17:30:16.303659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:10.043156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816224+0000","last_change":"2026-02-24T17:25:36.988365+0000","last_active":"2026-02-24T17:30:16.816224+0000","last_peered":"2026-02-24T17:30:16.816224+0000","last_clean":"2026-02-24T17:30:16.816224+0000","last_became_active":"2026-02-24T17:25:36.988207+0000","last_became_peered":"2026-02-24T17:25:36.988207+0000","last_unstale":"2026-02-24T17:30:16.816224+0000","last_undegraded":"2026-02-24T17:30:16.816224+0000","last_fullsized":"2026-02-24T17:30:16.816224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:44:31.138787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420667+0000","last_change":"2026-02-24T17:25:37.008436+0000","last_active":"2026-02-24T17:30:16.420667+0000","last_peered":"2026-02-24T17:30:16.420667+0000","last_clean":"2026-02-24T17:30:16.420667+0000","last_became_active":"2026-02-24T17:25:37.002254+0000","last_became_peered":"2026-02-24T17:25:37.002254+0000","last_unstale":"2026-02-24T17:30:16.420667+0000","last_undegraded":"2026-02-24T17:30:16.420667+0000","last_fullsized":"2026-02-24T17:30:16.420667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:10:08.553481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"32'11","reported_seq":584,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:17.105921+0000","last_change":"2026-02-24T17:25:36.955772+0000","last_active":"2026-02-24T17:30:17.105921+0000","last_peered":"2026-02-24T17:30:17.105921+0000","last_clean":"2026-02-24T17:30:17.105921+0000","last_became_active":"2026-02-24T17:25:36.954370+0000","last_became_peered":"2026-02-24T17:25:36.954370+0000","last_unstale":"2026-02-24T17:30:17.105921+0000","last_undegraded":"2026-02-24T17:30:17.105921+0000","last_fullsized":"2026-02-24T17:30:17.105921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:00:02.410830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816819+0000","last_change":"2026-02-24T17:25:36.967349+0000","last_active":"2026-02-24T17:30:16.816819+0000","last_peered":"2026-02-24T17:30:16.816819+0000","last_clean":"2026-02-24T17:30:16.816819+0000","last_became_active":"2026-02-24T17:25:36.967164+0000","last_became_peered":"2026-02-24T17:25:36.967164+0000","last_unstale":"2026-02-24T17:30:16.816819+0000","last_undegraded":"2026-02-24T17:30:16.816819+0000","last_fullsized":"2026-02-24T17:30:16.816819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:24:47.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":561,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.603289+0000","last_change":"2026-02-24T17:25:36.943423+0000","last_active":"2026-02-24T17:30:16.603289+0000","last_peered":"2026-02-24T17:30:16.603289+0000","last_clean":"2026-02-24T17:30:16.603289+0000","last_became_active":"2026-02-24T17:25:36.941089+0000","last_became_peered":"2026-02-24T17:25:36.941089+0000","last_unstale":"2026-02-24T17:30:16.603289+0000","last_undegraded":"2026-02-24T17:30:16.603289+0000","last_fullsized":"2026-02-24T17:30:16.603289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:21:37.674638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816167+0000","last_change":"2026-02-24T17:25:36.939435+0000","last_active":"2026-02-24T17:30:16.816167+0000","last_peered":"2026-02-24T17:30:16.816167+0000","last_clean":"2026-02-24T17:30:16.816167+0000","last_became_active":"2026-02-24T17:25:36.938491+0000","last_became_peered":"2026-02-24T17:25:36.938491+0000","last_unstale":"2026-02-24T17:30:16.816167+0000","last_undegraded":"2026-02-24T17:30:16.816167+0000","last_fullsized":"2026-02-24T17:30:16.816167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:36:23.352712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":560,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.603937+0000","last_change":"2026-02-24T17:25:36.938161+0000","last_active":"2026-02-24T17:30:16.603937+0000","last_peered":"2026-02-24T17:30:16.603937+0000","last_clean":"2026-02-24T17:30:16.603937+0000","last_became_active":"2026-02-24T17:25:36.937025+0000","last_became_peered":"2026-02-24T17:25:36.937025+0000","last_unstale":"2026-02-24T17:30:16.603937+0000","last_undegraded":"2026-02-24T17:30:16.603937+0000","last_fullsized":"2026-02-24T17:30:16.603937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:40:14.141988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420968+0000","last_change":"2026-02-24T17:25:36.988471+0000","last_active":"2026-02-24T17:30:16.420968+0000","last_peered":"2026-02-24T17:30:16.420968+0000","last_clean":"2026-02-24T17:30:16.420968+0000","last_became_active":"2026-02-24T17:25:36.985324+0000","last_became_peered":"2026-02-24T17:25:36.985324+0000","last_unstale":"2026-02-24T17:30:16.420968+0000","last_undegraded":"2026-02-24T17:30:16.420968+0000","last_fullsized":"2026-02-24T17:30:16.420968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:56:48.935815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.899835+0000","last_change":"2026-02-24T17:25:36.928873+0000","last_active":"2026-02-24T17:30:16.899835+0000","last_peered":"2026-02-24T17:30:16.899835+0000","last_clean":"2026-02-24T17:30:16.899835+0000","last_became_active":"2026-02-24T17:25:36.928525+0000","last_became_peered":"2026-02-24T17:25:36.928525+0000","last_unstale":"2026-02-24T17:30:16.899835+0000","last_undegraded":"2026-02-24T17:30:16.899835+0000","last_fullsized":"2026-02-24T17:30:16.899835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:02:20.618977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":2,"acting":2,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":2,"up_from":21,"seq":90194313282,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3248436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189403,"internal_metadata":27401253},"hb_peers":[0,1,3,4,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":21,"seq":90194313283,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2937,"kb_used_meta":24006,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3252877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3007961,"internal_metadata":24582695},"hb_peers":[0,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2993,"kb_used_meta":23950,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3267610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3065731,"internal_metadata":24524925},"hb_peers":[0,4,5,6,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313284,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":5412,"kb_used_omap":2970,"kb_used_meta":23973,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":5541888,"data_stored":3259528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3041792,"internal_metadata":24548864},"hb_peers":[1,3,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313283,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":5444,"kb_used_omap":5476,"kb_used_meta":21467,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":5574656,"data_stored":3262696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5607519,"internal_metadata":21983137},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313282,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":5400,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":5529600,"data_stored":3255127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[0,2,3,4,6,7,9,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3264371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3063988,"internal_metadata":24526668},"hb_peers":[0,2,4,5,7,8,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313282,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":183,"kb_used_meta":26760,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3244929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187407,"internal_metadata":27403249},"hb_peers":[1,3,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313283,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":5976,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":6119424,"data_stored":3835511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":192289,"internal_metadata":27398367},"hb_peers":[2,4,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":6020,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":6164480,"data_stored":3841297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188812,"internal_metadata":27401844},"hb_peers":[0,1,3,5,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":5468,"kb_used_omap":188,"kb_used_meta":26755,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":5599232,"data_stored":3272622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":193209,"internal_metadata":27397447},"hb_peers":[0,1,6,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":5448,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":5578752,"data_stored":3262562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":191672,"internal_metadata":27398984},"hb_peers":[0,3,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313283,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":5404,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":5533696,"data_stored":3252627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[2,4,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313282,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":5436,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":5566464,"data_stored":3261683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3064212,"internal_metadata":24526444},"hb_peers":[0,4,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313282,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2994,"kb_used_meta":23949,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3265804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3066142,"internal_metadata":24524514},"hb_peers":[0,2,3,4,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3257291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190563,"internal_metadata":27400093},"hb_peers":[1,3,4,6,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T17:30:26.646 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T17:30:26.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f3189d35640 1 Processor -- start 2026-02-24T17:30:26.716 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f3189d35640 1 -- start start 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f3189d35640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f318415a010 0x7f31840565f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f3189d35640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f3184164b40 0x7f3184166c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f3189d35640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3184056b30 con 0x7f3184167180 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f3189d35640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f3184056e00 con 0x7f318415a010 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f3189d35640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f31840570e0 con 0x7f3184164b40 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f31837fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f318415a010 0x7f31840565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f31837fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f318415a010 0x7f31840565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57458/0 (socket says 10.20.193.40:57458) 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f3182ffd640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f3184164b40 0x7f3184166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.715+0000 7f31837fe640 1 -- 10.20.193.40:0/3801616403 learned_addr learned my addr 10.20.193.40:0/3801616403 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31837fe640 1 -- 10.20.193.40:0/3801616403 >> v2:10.20.193.109:3300/0 conn(0x7f3184164b40 msgr2=0x7f3184166c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:26.718 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31837fe640 1 --2- 10.20.193.40:0/3801616403 >> v2:10.20.193.109:3300/0 conn(0x7f3184164b40 0x7f3184166c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31837fe640 1 -- 10.20.193.40:0/3801616403 >> v1:10.20.193.109:6789/0 conn(0x7f3184167180 legacy=0x7f31840b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.719 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31837fe640 1 -- 10.20.193.40:0/3801616403 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31840573c0 con 0x7f318415a010 2026-02-24T17:30:26.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31837fe640 1 --2- 10.20.193.40:0/3801616403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f31840565f0 secure :-1 s=READY pgs=5150 gs=2 cs=0 l=1 c_cookie=1653656614623432189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3184056560 tx=0x7f317001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f2f7edf71acdfd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31827fc640 1 -- 10.20.193.40:0/3801616403 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31700a9620 con 0x7f318415a010 2026-02-24T17:30:26.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31827fc640 1 -- 10.20.193.40:0/3801616403 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31700a97c0 con 0x7f318415a010 2026-02-24T17:30:26.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31827fc640 1 -- 10.20.193.40:0/3801616403 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31700a9bb0 con 0x7f318415a010 2026-02-24T17:30:26.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- 10.20.193.40:0/3801616403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 msgr2=0x7f31840565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.723 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 --2- 10.20.193.40:0/3801616403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f31840565f0 secure :-1 s=READY pgs=5150 gs=2 cs=0 l=1 c_cookie=1653656614623432189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3184056560 tx=0x7f317001c540 comp rx=0 tx=0).stop 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- 10.20.193.40:0/3801616403 shutdown_connections 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 --2- 10.20.193.40:0/3801616403 >> v2:10.20.193.109:3300/0 conn(0x7f3184164b40 0x7f3184166c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 --2- 10.20.193.40:0/3801616403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f31840565f0 unknown :-1 s=CLOSED pgs=5150 gs=2 cs=0 l=1 c_cookie=1653656614623432189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- 10.20.193.40:0/3801616403 >> 10.20.193.40:0/3801616403 conn(0x7f31840b8fd0 msgr2=0x7f31840b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- 10.20.193.40:0/3801616403 shutdown_connections 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- 10.20.193.40:0/3801616403 wait complete. 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 librados: starting msgr at 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 librados: starting objecter 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 Processor -- start 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- start start 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 librados: setting wanted keys 2026-02-24T17:30:26.724 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 librados: calling monclient init 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f318415a7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3184164b40 0x7f3184122440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3184167180 0x7f318414cdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f31840b4de0 con 0x7f318415a010 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f3184167580 con 0x7f3184167180 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f3189d35640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f31840b4f60 con 0x7f3184164b40 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.719+0000 7f31837fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f318415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f31837fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f318415a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57464/0 (socket says 10.20.193.40:57464) 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f31837fe640 1 -- 10.20.193.40:0/1635311003 learned_addr learned my addr 10.20.193.40:0/1635311003 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3182ffd640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3184164b40 0x7f3184122440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3183fff640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3184167180 0x7f318414cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.725 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f31837fe640 1 -- 10.20.193.40:0/1635311003 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3184164b40 msgr2=0x7f3184122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f31837fe640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3184164b40 0x7f3184122440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f31837fe640 1 -- 10.20.193.40:0/1635311003 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3184167180 msgr2=0x7f318414cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f31837fe640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3184167180 0x7f318414cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f31837fe640 1 -- 10.20.193.40:0/1635311003 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31841c7dc0 con 0x7f318415a010 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f31837fe640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f318415a7f0 secure :-1 s=READY pgs=5151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3170002410 tx=0x7f317001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 10 client.?.objecter ms_handle_connect 0x7f318415a010 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 1 -- 10.20.193.40:0/1635311003 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31700a9e10 con 0x7f318415a010 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 1 -- 10.20.193.40:0/1635311003 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3170004030 con 0x7f318415a010 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 1 -- 10.20.193.40:0/1635311003 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3170004400 con 0x7f318415a010 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318415ad30 con 0x7f318415a010 2026-02-24T17:30:26.726 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3189d35640 10 client.25314.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318415d450 con 0x7f318415a010 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3189d35640 1 librados: init done 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318415a3e0 con 0x7f318415a010 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 1 -- 10.20.193.40:0/1635311003 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f31700bb030 con 0x7f318415a010 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 1 --2- 10.20.193.40:0/1635311003 >> v2:10.20.193.120:6800/397309233 conn(0x7f3154074100 0x7f31540945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 1 -- 10.20.193.40:0/1635311003 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f31700a6040 con 0x7f318415a010 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 10 client.25314.objecter ms_dispatch2 0x7f3184000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 3 client.25314.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 3 client.25314.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 20 client.25314.objecter dump_active .. 0 homeless 2026-02-24T17:30:26.727 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3182ffd640 1 --2- 10.20.193.40:0/1635311003 >> v2:10.20.193.120:6800/397309233 conn(0x7f3154074100 0x7f31540945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:26.728 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f315ffff640 10 client.25314.objecter ms_handle_connect 0x7f3154074100 2026-02-24T17:30:26.728 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.723+0000 7f3182ffd640 1 --2- 10.20.193.40:0/1635311003 >> v2:10.20.193.120:6800/397309233 conn(0x7f3154074100 0x7f31540945b0 secure :-1 s=READY pgs=2230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f318405de50 tx=0x7f3174009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:26.728 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.727+0000 7f315ffff640 1 -- 10.20.193.40:0/1635311003 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f31700c3030 con 0x7f318415a010 2026-02-24T17:30:26.819 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f318413d360 con 0x7f318415a010 2026-02-24T17:30:26.820 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f315ffff640 1 -- 10.20.193.40:0/1635311003 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v311) ==== 74+0+23447 (secure 0 0 0) 0x7f31700ad020 con 0x7f318415a010 2026-02-24T17:30:26.820 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:30:26.820 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":311,"fsid":"f24f61d3-eddb-4c62-878a-4823ddf02ae6","created":"2026-02-24T17:24:53.565540+0000","modified":"2026-02-24T17:30:16.301292+0000","last_up_change":"2026-02-24T17:25:00.591515+0000","last_in_change":"2026-02-24T17:24:56.443925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":99,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T17:25:01.895992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T17:25:06.322777+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9499998092651367,"score_stable":5.9499998092651367,"optimal_score":0.62999999523162842,"raw_score_acting":3.75,"raw_score_stable":3.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-24T17:25:35.598370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":3.5,"score_stable":3.5,"optimal_score":1,"raw_score_acting":3.5,"raw_score_stable":3.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a63c8bf5-8276-4498-bfa8-84f1c5088edb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":293,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":1676722186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6805","nonce":1676722186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6807","nonce":1676722186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":1676722186}]},"public_addr":"10.20.193.40:6804/1676722186","cluster_addr":"10.20.193.40:6805/1676722186","heartbeat_back_addr":"10.20.193.40:6807/1676722186","heartbeat_front_addr":"10.20.193.40:6806/1676722186","state":["exists","up"]},{"osd":1,"uuid":"8145c280-0f0a-4c92-8026-76099c124e29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6808","nonce":2000550170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6809","nonce":2000550170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6811","nonce":2000550170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6810","nonce":2000550170}]},"public_addr":"10.20.193.94:6808/2000550170","cluster_addr":"10.20.193.94:6809/2000550170","heartbeat_back_addr":"10.20.193.94:6811/2000550170","heartbeat_front_addr":"10.20.193.94:6810/2000550170","state":["exists","up"]},{"osd":2,"uuid":"c2f26f49-f93a-43e9-b17b-871ec271af4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6800","nonce":1855643564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":1855643564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":1855643564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":1855643564}]},"public_addr":"10.20.193.109:6800/1855643564","cluster_addr":"10.20.193.109:6802/1855643564","heartbeat_back_addr":"10.20.193.109:6806/1855643564","heartbeat_front_addr":"10.20.193.109:6804/1855643564","state":["exists","up"]},{"osd":3,"uuid":"29f34fbd-eed3-4f11-8368-c83f4c080816","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6806","nonce":679060341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6808","nonce":679060341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6812","nonce":679060341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6811","nonce":679060341}]},"public_addr":"10.20.193.120:6806/679060341","cluster_addr":"10.20.193.120:6808/679060341","heartbeat_back_addr":"10.20.193.120:6812/679060341","heartbeat_front_addr":"10.20.193.120:6811/679060341","state":["exists","up"]},{"osd":4,"uuid":"50ae3b8b-d20f-4b0d-893f-f6a8ca4453ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":2818881548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6801","nonce":2818881548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6803","nonce":2818881548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":2818881548}]},"public_addr":"10.20.193.40:6800/2818881548","cluster_addr":"10.20.193.40:6801/2818881548","heartbeat_back_addr":"10.20.193.40:6803/2818881548","heartbeat_front_addr":"10.20.193.40:6802/2818881548","state":["exists","up"]},{"osd":5,"uuid":"39b6c845-a7fd-440b-9d84-1969c6236693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":305,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6804","nonce":1872957733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6805","nonce":1872957733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6807","nonce":1872957733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6806","nonce":1872957733}]},"public_addr":"10.20.193.94:6804/1872957733","cluster_addr":"10.20.193.94:6805/1872957733","heartbeat_back_addr":"10.20.193.94:6807/1872957733","heartbeat_front_addr":"10.20.193.94:6806/1872957733","state":["exists","up"]},{"osd":6,"uuid":"ca53011f-6445-46ff-bee3-5ac8c76d24f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6809","nonce":2048261086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6811","nonce":2048261086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6815","nonce":2048261086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6813","nonce":2048261086}]},"public_addr":"10.20.193.109:6809/2048261086","cluster_addr":"10.20.193.109:6811/2048261086","heartbeat_back_addr":"10.20.193.109:6815/2048261086","heartbeat_front_addr":"10.20.193.109:6813/2048261086","state":["exists","up"]},{"osd":7,"uuid":"c4862062-f74a-4802-be50-4ac14c0f40f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6813","nonce":1724095478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6814","nonce":1724095478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6816","nonce":1724095478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6815","nonce":1724095478}]},"public_addr":"10.20.193.120:6813/1724095478","cluster_addr":"10.20.193.120:6814/1724095478","heartbeat_back_addr":"10.20.193.120:6816/1724095478","heartbeat_front_addr":"10.20.193.120:6815/1724095478","state":["exists","up"]},{"osd":8,"uuid":"ecbb5459-70a3-4d39-910c-27e89ee16ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":299,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":1991872075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6809","nonce":1991872075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6811","nonce":1991872075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":1991872075}]},"public_addr":"10.20.193.40:6808/1991872075","cluster_addr":"10.20.193.40:6809/1991872075","heartbeat_back_addr":"10.20.193.40:6811/1991872075","heartbeat_front_addr":"10.20.193.40:6810/1991872075","state":["exists","up"]},{"osd":9,"uuid":"c08fc40c-17cc-44e9-9250-afa1539de8c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6800","nonce":3536923368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6801","nonce":3536923368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6803","nonce":3536923368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6802","nonce":3536923368}]},"public_addr":"10.20.193.94:6800/3536923368","cluster_addr":"10.20.193.94:6801/3536923368","heartbeat_back_addr":"10.20.193.94:6803/3536923368","heartbeat_front_addr":"10.20.193.94:6802/3536923368","state":["exists","up"]},{"osd":10,"uuid":"222e48db-8734-4e1b-885d-90de04f44ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":194638238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":194638238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":194638238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":194638238}]},"public_addr":"10.20.193.109:6808/194638238","cluster_addr":"10.20.193.109:6810/194638238","heartbeat_back_addr":"10.20.193.109:6814/194638238","heartbeat_front_addr":"10.20.193.109:6812/194638238","state":["exists","up"]},{"osd":11,"uuid":"c1ccd78b-db99-4911-8140-67f0af870949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6801","nonce":50161754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6802","nonce":50161754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6804","nonce":50161754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6803","nonce":50161754}]},"public_addr":"10.20.193.120:6801/50161754","cluster_addr":"10.20.193.120:6802/50161754","heartbeat_back_addr":"10.20.193.120:6804/50161754","heartbeat_front_addr":"10.20.193.120:6803/50161754","state":["exists","up"]},{"osd":12,"uuid":"4c58eff7-882b-4bfd-9816-137d0e3ed5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":730213184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6813","nonce":730213184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6815","nonce":730213184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":730213184}]},"public_addr":"10.20.193.40:6812/730213184","cluster_addr":"10.20.193.40:6813/730213184","heartbeat_back_addr":"10.20.193.40:6815/730213184","heartbeat_front_addr":"10.20.193.40:6814/730213184","state":["exists","up"]},{"osd":13,"uuid":"013e1c78-dbc4-4789-9c0b-56e1e9f54a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6812","nonce":666336223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6813","nonce":666336223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6815","nonce":666336223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.94:6814","nonce":666336223}]},"public_addr":"10.20.193.94:6812/666336223","cluster_addr":"10.20.193.94:6813/666336223","heartbeat_back_addr":"10.20.193.94:6815/666336223","heartbeat_front_addr":"10.20.193.94:6814/666336223","state":["exists","up"]},{"osd":14,"uuid":"a54b9053-910e-47f8-9f50-6366eb58ea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6801","nonce":1905173416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6803","nonce":1905173416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6807","nonce":1905173416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6805","nonce":1905173416}]},"public_addr":"10.20.193.109:6801/1905173416","cluster_addr":"10.20.193.109:6803/1905173416","heartbeat_back_addr":"10.20.193.109:6807/1905173416","heartbeat_front_addr":"10.20.193.109:6805/1905173416","state":["exists","up"]},{"osd":15,"uuid":"d208141f-10d4-45e4-938a-3971dcc08dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":309,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6805","nonce":2868608910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6807","nonce":2868608910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6810","nonce":2868608910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.120:6809","nonce":2868608910}]},"public_addr":"10.20.193.120:6805/2868608910","cluster_addr":"10.20.193.120:6807/2868608910","heartbeat_back_addr":"10.20.193.120:6810/2868608910","heartbeat_front_addr":"10.20.193.120:6809/2868608910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.982747+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.062221+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.927660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.930679+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.017395+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.103413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.917466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.959311+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.957242+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.106278+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.884709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.824262+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.009640+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:59.247045+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.835352+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T17:24:58.952132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":10,"snaps":[{"begin":3,"length":2}]},{"pool":14,"snaps":[{"begin":3,"length":4}]},{"pool":31,"snaps":[{"begin":1,"length":1}]},{"pool":61,"snaps":[{"begin":1,"length":1}]},{"pool":90,"snaps":[{"begin":4,"length":2},{"begin":7,"length":1},{"begin":9,"length":1}]},{"pool":102,"snaps":[{"begin":1,"length":1}]},{"pool":119,"snaps":[{"begin":1,"length":2}]},{"pool":134,"snaps":[{"begin":3,"length":1}]},{"pool":142,"snaps":[{"begin":3,"length":2}]},{"pool":148,"snaps":[{"begin":2,"length":2}]},{"pool":158,"snaps":[{"begin":2,"length":3}]},{"pool":166,"snaps":[{"begin":2,"length":4}]},{"pool":168,"snaps":[{"begin":2,"length":2}]},{"pool":178,"snaps":[{"begin":2,"length":1}]},{"pool":183,"snaps":[{"begin":2,"length":3}]},{"pool":196,"snaps":[{"begin":6,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 10 librados: watch_flush enter 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 10 librados: watch_flush exit 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 20 client.25314.objecter shutdown clearing up homeless session... 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 10 client.25314.objecter successfully canceled tick 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 >> v2:10.20.193.120:6800/397309233 conn(0x7f3154074100 msgr2=0x7f31540945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 1 --2- 10.20.193.40:0/1635311003 >> v2:10.20.193.120:6800/397309233 conn(0x7f3154074100 0x7f31540945b0 secure :-1 s=READY pgs=2230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f318405de50 tx=0x7f3174009290 comp rx=0 tx=0).stop 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 msgr2=0x7f318415a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.819+0000 7f3189d35640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f318415a7f0 secure :-1 s=READY pgs=5151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3170002410 tx=0x7f317001ad80 comp rx=0 tx=0).stop 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 shutdown_connections 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 --2- 10.20.193.40:0/1635311003 >> v2:10.20.193.120:6800/397309233 conn(0x7f3154074100 0x7f31540945b0 unknown :-1 s=CLOSED pgs=2230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f3184167180 0x7f318414cdc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f3184164b40 0x7f3184122440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 --2- 10.20.193.40:0/1635311003 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f318415a010 0x7f318415a7f0 unknown :-1 s=CLOSED pgs=5151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 >> 10.20.193.40:0/1635311003 conn(0x7f31840b8fd0 msgr2=0x7f31840b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 shutdown_connections 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 -- 10.20.193.40:0/1635311003 wait complete. 2026-02-24T17:30:26.821 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:26.823+0000 7f3189d35640 1 librados: shutdown 2026-02-24T17:30:27.834 INFO:tasks.ceph:Scrubbing osd.0 2026-02-24T17:30:27.834 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:27.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd92c8640 1 Processor -- start 2026-02-24T17:30:27.898 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd92c8640 1 -- start start 2026-02-24T17:30:27.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd92c8640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fafd40b2840 0x7fafd415b300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd92c8640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd4165580 con 0x7fafd415af30 2026-02-24T17:30:27.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd92c8640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd405d0c0 con 0x7fafd405e590 2026-02-24T17:30:27.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd92c8640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fafd405d9f0 con 0x7fafd40b2840 2026-02-24T17:30:27.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd2ffd640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fafd415af30 0x7fafd405de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34424/0 (socket says 10.20.193.40:34424) 2026-02-24T17:30:27.899 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd2ffd640 1 -- 10.20.193.40:0/733420785 learned_addr learned my addr 10.20.193.40:0/733420785 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd37fe640 1 --2- 10.20.193.40:0/733420785 >> v2:10.20.193.94:3300/0 conn(0x7fafd40b2840 0x7fafd415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815213711 0 0) 0x7fafd4165580 con 0x7fafd415af30 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafc0003620 con 0x7fafd415af30 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2385776623 0 0) 0x7fafc0003620 con 0x7fafd415af30 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 >> v2:10.20.193.94:3300/0 conn(0x7fafd40b2840 msgr2=0x7fafd415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 --2- 10.20.193.40:0/733420785 >> v2:10.20.193.94:3300/0 conn(0x7fafd40b2840 0x7fafd415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 >> v1:10.20.193.94:6789/0 conn(0x7fafd405e590 legacy=0x7fafd40b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd405d3a0 con 0x7fafd415af30 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7fafc8002e80 con 0x7fafd415af30 2026-02-24T17:30:27.900 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 >> v1:10.20.193.40:6789/0 conn(0x7fafd415af30 legacy=0x7fafd405de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fafc0003ba0 0x7fafc0003fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fafc00048d0 0x7fafc0004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafc00052d0 0x7fafc0065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fafd405d9f0 con 0x7fafc00052d0 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fafc0066210 con 0x7fafc0003ba0 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fafc0066410 con 0x7fafc00048d0 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd37fe640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafc00052d0 0x7fafc0065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd2ffd640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fafc0003ba0 0x7fafc0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd27fc640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fafc00048d0 0x7fafc0004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd37fe640 1 -- 10.20.193.40:0/733420785 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fafc00048d0 msgr2=0x7fafc0004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd37fe640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fafc00048d0 0x7fafc0004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd37fe640 1 -- 10.20.193.40:0/733420785 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fafc0003ba0 msgr2=0x7fafc0003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd37fe640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fafc0003ba0 0x7fafc0003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:27.901 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.899+0000 7fafd37fe640 1 -- 10.20.193.40:0/733420785 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc0003620 con 0x7fafc00052d0 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd37fe640 1 -- 10.20.193.40:0/733420785 reap_dead start 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd37fe640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafc00052d0 0x7fafc0065a90 secure :-1 s=READY pgs=5153 gs=4 cs=0 l=1 c_cookie=11577507745272348295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafc4005c90 tx=0x7fafc401dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ab91f43d4abe87 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fafc400ab80 con 0x7fafc00052d0 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc40a6c20 con 0x7fafc00052d0 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd1ffb640 1 -- 10.20.193.40:0/733420785 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fafc40ae430 con 0x7fafc00052d0 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- 10.20.193.40:0/733420785 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafc00052d0 msgr2=0x7fafc0065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafc00052d0 0x7fafc0065a90 secure :-1 s=READY pgs=5153 gs=4 cs=0 l=1 c_cookie=11577507745272348295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafc4005c90 tx=0x7fafc401dc00 comp rx=0 tx=0).stop 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- 10.20.193.40:0/733420785 shutdown_connections 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 --2- 10.20.193.40:0/733420785 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafc00052d0 0x7fafc0065a90 unknown :-1 s=CLOSED pgs=5153 gs=4 cs=0 l=1 c_cookie=11577507745272348295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- 10.20.193.40:0/733420785 >> 10.20.193.40:0/733420785 conn(0x7fafd40b58a0 msgr2=0x7fafd40b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- 10.20.193.40:0/733420785 shutdown_connections 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- 10.20.193.40:0/733420785 wait complete. 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 librados: starting msgr at 2026-02-24T17:30:27.902 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 librados: starting objecter 2026-02-24T17:30:27.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 Processor -- start 2026-02-24T17:30:27.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- start start 2026-02-24T17:30:27.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 librados: setting wanted keys 2026-02-24T17:30:27.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 librados: calling monclient init 2026-02-24T17:30:27.903 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fafc00052d0 0x7fafd4156550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafd4156ec0 0x7fafd41fbc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fafd41fc150 0x7fafd4164960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fafd415b300 con 0x7fafd4156ec0 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fafd405cdc0 con 0x7fafc00052d0 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fafd415b480 con 0x7fafd41fc150 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafd4156ec0 0x7fafd41fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafd4156ec0 0x7fafd41fbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57490/0 (socket says 10.20.193.40:57490) 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 -- 10.20.193.40:0/1998556953 learned_addr learned my addr 10.20.193.40:0/1998556953 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd2ffd640 1 --2- 10.20.193.40:0/1998556953 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fafc00052d0 0x7fafd4156550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.904 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd37fe640 1 --2- 10.20.193.40:0/1998556953 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fafd41fc150 0x7fafd4164960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 -- 10.20.193.40:0/1998556953 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fafd41fc150 msgr2=0x7fafd4164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 --2- 10.20.193.40:0/1998556953 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fafd41fc150 0x7fafd4164960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 -- 10.20.193.40:0/1998556953 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fafc00052d0 msgr2=0x7fafd4156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 --2- 10.20.193.40:0/1998556953 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fafc00052d0 0x7fafd4156550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 -- 10.20.193.40:0/1998556953 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd41fc5c0 con 0x7fafd4156ec0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd27fc640 1 --2- 10.20.193.40:0/1998556953 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafd4156ec0 0x7fafd41fbc10 secure :-1 s=READY pgs=5154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafbc00e5a0 tx=0x7fafbc00ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafb37fe640 10 client.?.objecter ms_handle_connect 0x7fafd4156ec0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafb37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fafbc0068d0 con 0x7fafd4156ec0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc006a70 con 0x7fafd4156ec0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd415f0c0 con 0x7fafd4156ec0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fafbc006e60 con 0x7fafd4156ec0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 10 client.25320.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd415f640 con 0x7fafd4156ec0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 librados: init done 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 10 client.25320.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 15 client.25320.objecter _session_command_op_assign -1 1 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 20 client.25320.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 10 client.25320.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.903+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fafd40b36d0 con 0x7fafd4156ec0 2026-02-24T17:30:27.905 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fafbc007020 con 0x7fafd4156ec0 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 1 --2- 10.20.193.40:0/1998556953 >> v2:10.20.193.120:6800/397309233 conn(0x7fafa0074100 0x7fafa00945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fafbc018020 con 0x7fafd4156ec0 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 10 client.25320.objecter ms_dispatch2 0x7fafd4000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 3 client.25320.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 3 client.25320.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 10 client.25320.objecter checking command 1 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 1 --2- 10.20.193.40:0/1998556953 >> v2:10.20.193.40:6804/1676722186 conn(0x7fafa009b440 0x7fafa00bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 20 client.25320.objecter _get_session s=0x7fafa009ad90 osd=0 3 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 20 client.25320.objecter put_session s=0x7fafa009ad90 osd=0 3 2026-02-24T17:30:27.906 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 15 client.25320.objecter _session_command_op_remove -1 1 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 20 client.25320.objecter _get_session s=0x7fafa009ad90 osd=0 3 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 20 client.25320.objecter get_session s=0x7fafa009ad90 osd=0 3 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 15 client.25320.objecter _session_command_op_assign 0 1 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 20 client.25320.objecter put_session s=0x7fafa009ad90 osd=0 4 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 10 client.25320.objecter _send_command 1 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 --> v2:10.20.193.40:6804/1676722186 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafbc026e50 con 0x7fafa009b440 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 20 client.25320.objecter dump_active .. 0 homeless 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fafbc096ae0 con 0x7fafd4156ec0 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafd2ffd640 1 --2- 10.20.193.40:0/1998556953 >> v2:10.20.193.120:6800/397309233 conn(0x7fafa0074100 0x7fafa00945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafd37fe640 1 --2- 10.20.193.40:0/1998556953 >> v2:10.20.193.40:6804/1676722186 conn(0x7fafa009b440 0x7fafa00bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 10 client.25320.objecter ms_handle_connect 0x7fafa009b440 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafd37fe640 1 --2- 10.20.193.40:0/1998556953 >> v2:10.20.193.40:6804/1676722186 conn(0x7fafa009b440 0x7fafa00bb8d0 crc :-1 s=READY pgs=78 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 10 client.25320.objecter ms_handle_connect 0x7fafa0074100 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafd2ffd640 1 --2- 10.20.193.40:0/1998556953 >> v2:10.20.193.120:6800/397309233 conn(0x7fafa0074100 0x7fafa00945b0 secure :-1 s=READY pgs=2231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafc8002830 tx=0x7fafc8007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 <== osd.0 v2:10.20.193.40:6804/1676722186 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fafbc026e50 con 0x7fafa009b440 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 10 client.25320.objecter ms_dispatch2 0x7fafd4000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 10 client.25320.objecter _finish_command 1 = system:0 2026-02-24T17:30:27.907 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 20 client.25320.objecter put_session s=0x7fafa009ad90 osd=0 4 2026-02-24T17:30:27.908 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.907+0000 7fafb37fe640 15 client.25320.objecter _session_command_op_remove 0 1 2026-02-24T17:30:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 10 client.25320.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 15 client.25320.objecter _session_command_op_assign -1 2 2026-02-24T17:30:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 20 client.25320.objecter _get_session s=0x7fafa009ad90 osd=0 3 2026-02-24T17:30:27.914 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 20 client.25320.objecter put_session s=0x7fafa009ad90 osd=0 3 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 20 client.25320.objecter _get_session s=0x7fafa009ad90 osd=0 3 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 15 client.25320.objecter _session_command_op_remove -1 2 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 20 client.25320.objecter get_session s=0x7fafa009ad90 osd=0 3 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 15 client.25320.objecter _session_command_op_assign 0 2 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 20 client.25320.objecter put_session s=0x7fafa009ad90 osd=0 4 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 10 client.25320.objecter _send_command 2 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 --> v2:10.20.193.40:6804/1676722186 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fafd4159cb0 con 0x7fafa009b440 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafb37fe640 1 -- 10.20.193.40:0/1998556953 <== osd.0 v2:10.20.193.40:6804/1676722186 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fafd4159cb0 con 0x7fafa009b440 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafb37fe640 10 client.25320.objecter ms_dispatch2 0x7fafd4000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafb37fe640 10 client.25320.objecter _finish_command 2 = system:0 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafb37fe640 20 client.25320.objecter put_session s=0x7fafa009ad90 osd=0 4 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafb37fe640 15 client.25320.objecter _session_command_op_remove 0 2 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 10 librados: watch_flush enter 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 10 librados: watch_flush exit 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 10 client.25320.objecter close_session for osd.0 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 >> v2:10.20.193.40:6804/1676722186 conn(0x7fafa009b440 msgr2=0x7fafa00bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 --2- 10.20.193.40:0/1998556953 >> v2:10.20.193.40:6804/1676722186 conn(0x7fafa009b440 0x7fafa00bb8d0 crc :-1 s=READY pgs=78 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 20 client.25320.objecter put_session s=0x7fafa009ad90 osd=0 1 2026-02-24T17:30:27.915 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 20 client.25320.objecter shutdown clearing up homeless session... 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 10 client.25320.objecter successfully canceled tick 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 >> v2:10.20.193.120:6800/397309233 conn(0x7fafa0074100 msgr2=0x7fafa00945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 --2- 10.20.193.40:0/1998556953 >> v2:10.20.193.120:6800/397309233 conn(0x7fafa0074100 0x7fafa00945b0 secure :-1 s=READY pgs=2231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafc8002830 tx=0x7fafc8007040 comp rx=0 tx=0).stop 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafd4156ec0 msgr2=0x7fafd41fbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 --2- 10.20.193.40:0/1998556953 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fafd4156ec0 0x7fafd41fbc10 secure :-1 s=READY pgs=5154 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafbc00e5a0 tx=0x7fafbc00ea60 comp rx=0 tx=0).stop 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd37fe640 1 -- 10.20.193.40:0/1998556953 reap_dead start 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 shutdown_connections 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 >> 10.20.193.40:0/1998556953 conn(0x7fafd40b58a0 msgr2=0x7fafd4163fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 shutdown_connections 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 -- 10.20.193.40:0/1998556953 wait complete. 2026-02-24T17:30:27.916 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.915+0000 7fafd92c8640 1 librados: shutdown 2026-02-24T17:30:27.924 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-24T17:30:27.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb286c31640 1 Processor -- start 2026-02-24T17:30:27.996 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb286c31640 1 -- start start 2026-02-24T17:30:27.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb286c31640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28016e870 con 0x7fb28016ba90 2026-02-24T17:30:27.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb286c31640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28016eb50 con 0x7fb280161c70 2026-02-24T17:30:27.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb286c31640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28016ee30 con 0x7fb2801618a0 2026-02-24T17:30:27.998 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2851a7640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fb28016ba90 0x7fb2800b3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34438/0 (socket says 10.20.193.40:34438) 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2851a7640 1 -- 10.20.193.40:0/808872385 learned_addr learned my addr 10.20.193.40:0/808872385 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509020740 0 0) 0x7fb28016e870 con 0x7fb28016ba90 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb26c003620 con 0x7fb28016ba90 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1657940751 0 0) 0x7fb26c003620 con 0x7fb28016ba90 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 >> v1:10.20.193.109:6789/0 conn(0x7fb2801618a0 legacy=0x7fb28016b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 >> v1:10.20.193.94:6789/0 conn(0x7fb280161c70 legacy=0x7fb2800b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28016f110 con 0x7fb28016ba90 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7fb27c004390 con 0x7fb28016ba90 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 >> v1:10.20.193.40:6789/0 conn(0x7fb28016ba90 legacy=0x7fb2800b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb26c003b50 0x7fb26c003f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.995+0000 7fb2777fe640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb26c0048d0 0x7fb26c004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2777fe640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c005480 0x7fb26c065ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:27.999 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c066380 con 0x7fb26c0048d0 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c066530 con 0x7fb26c005480 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c066730 con 0x7fb26c003b50 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb277fff640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb26c0048d0 0x7fb26c004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2851a7640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c005480 0x7fb26c065ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2849a6640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb26c003b50 0x7fb26c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb277fff640 1 -- 10.20.193.40:0/808872385 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb26c003b50 msgr2=0x7fb26c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb277fff640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb26c003b50 0x7fb26c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb277fff640 1 -- 10.20.193.40:0/808872385 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c005480 msgr2=0x7fb26c065ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb277fff640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c005480 0x7fb26c065ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2851a7640 1 -- 10.20.193.40:0/808872385 reap_dead start 2026-02-24T17:30:28.000 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb277fff640 1 -- 10.20.193.40:0/808872385 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c003620 con 0x7fb26c0048d0 2026-02-24T17:30:28.003 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb277fff640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb26c0048d0 0x7fb26c004d40 secure :-1 s=READY pgs=5156 gs=5 cs=0 l=1 c_cookie=16415007168702372075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb268007fd0 tx=0x7fb26801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cdd20cabfed8eb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2680b0070 con 0x7fb26c0048d0 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb268006af0 con 0x7fb26c0048d0 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb2777fe640 1 -- 10.20.193.40:0/808872385 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb268002c00 con 0x7fb26c0048d0 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 -- 10.20.193.40:0/808872385 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb26c0048d0 msgr2=0x7fb26c004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb26c0048d0 0x7fb26c004d40 secure :-1 s=READY pgs=5156 gs=5 cs=0 l=1 c_cookie=16415007168702372075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb268007fd0 tx=0x7fb26801c450 comp rx=0 tx=0).stop 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 -- 10.20.193.40:0/808872385 shutdown_connections 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 --2- 10.20.193.40:0/808872385 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb26c0048d0 0x7fb26c004d40 unknown :-1 s=CLOSED pgs=5156 gs=5 cs=0 l=1 c_cookie=16415007168702372075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 -- 10.20.193.40:0/808872385 >> 10.20.193.40:0/808872385 conn(0x7fb2800b8fd0 msgr2=0x7fb2800b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 -- 10.20.193.40:0/808872385 shutdown_connections 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 -- 10.20.193.40:0/808872385 wait complete. 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 librados: starting msgr at 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 librados: starting objecter 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 Processor -- start 2026-02-24T17:30:28.004 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 -- start start 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 librados: setting wanted keys 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:27.999+0000 7fb286c31640 1 librados: calling monclient init 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c0048d0 0x7fb28014c060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb28015c680 0x7fb28014cab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb28014cff0 0x7fb2800b7420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb280131c10 con 0x7fb28014cff0 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb2800b3ef0 con 0x7fb26c0048d0 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb2800b4070 con 0x7fb28015c680 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb28014cff0 0x7fb2800b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb28014cff0 0x7fb2800b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57498/0 (socket says 10.20.193.40:57498) 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 -- 10.20.193.40:0/3899344963 learned_addr learned my addr 10.20.193.40:0/3899344963 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.005 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2849a6640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c0048d0 0x7fb28014c060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb277fff640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb28015c680 0x7fb28014cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 -- 10.20.193.40:0/3899344963 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb28015c680 msgr2=0x7fb28014cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb28015c680 0x7fb28014cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 -- 10.20.193.40:0/3899344963 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c0048d0 msgr2=0x7fb28014c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c0048d0 0x7fb28014c060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 -- 10.20.193.40:0/3899344963 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb280167550 con 0x7fb28014cff0 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2849a6640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c0048d0 0x7fb28014c060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2851a7640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb28014cff0 0x7fb2800b7420 secure :-1 s=READY pgs=5157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb27c003920 tx=0x7fb27c00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 10 client.?.objecter ms_handle_connect 0x7fb28014cff0 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 1 -- 10.20.193.40:0/3899344963 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb27c01a070 con 0x7fb28014cff0 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 1 -- 10.20.193.40:0/3899344963 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c011810 con 0x7fb28014cff0 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 1 -- 10.20.193.40:0/3899344963 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb27c011c20 con 0x7fb28014cff0 2026-02-24T17:30:28.006 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb280167830 con 0x7fb28014cff0 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 10 client.25326.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb280167df0 con 0x7fb28014cff0 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 librados: init done 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2800b45e0 con 0x7fb28014cff0 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 1 -- 10.20.193.40:0/3899344963 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fb27c01e3b0 con 0x7fb28014cff0 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 1 --2- 10.20.193.40:0/3899344963 >> v2:10.20.193.120:6800/397309233 conn(0x7fb250074100 0x7fb2500945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 1 -- 10.20.193.40:0/3899344963 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fb27c011040 con 0x7fb28014cff0 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 10 client.25326.objecter ms_dispatch2 0x7fb280000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 3 client.25326.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 3 client.25326.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 20 client.25326.objecter dump_active .. 0 homeless 2026-02-24T17:30:28.007 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2849a6640 1 --2- 10.20.193.40:0/3899344963 >> v2:10.20.193.120:6800/397309233 conn(0x7fb250074100 0x7fb2500945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2849a6640 1 --2- 10.20.193.40:0/3899344963 >> v2:10.20.193.120:6800/397309233 conn(0x7fb250074100 0x7fb2500945b0 secure :-1 s=READY pgs=2232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb28016e590 tx=0x7fb270009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 10 client.25326.objecter ms_handle_connect 0x7fb250074100 2026-02-24T17:30:28.008 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.003+0000 7fb2757fa640 1 -- 10.20.193.40:0/3899344963 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fb27c024020 con 0x7fb28014cff0 2026-02-24T17:30:28.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.087+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb28014c5a0 con 0x7fb250074100 2026-02-24T17:30:28.089 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.087+0000 7fb2757fa640 1 -- 10.20.193.40:0/3899344963 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb270004d00 con 0x7fb250074100 2026-02-24T17:30:28.089 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 0 to deep-scrub 2026-02-24T17:30:28.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 10 librados: watch_flush enter 2026-02-24T17:30:28.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 10 librados: watch_flush exit 2026-02-24T17:30:28.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 20 client.25326.objecter shutdown clearing up homeless session... 2026-02-24T17:30:28.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 10 client.25326.objecter successfully canceled tick 2026-02-24T17:30:28.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 >> v2:10.20.193.120:6800/397309233 conn(0x7fb250074100 msgr2=0x7fb2500945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 --2- 10.20.193.40:0/3899344963 >> v2:10.20.193.120:6800/397309233 conn(0x7fb250074100 0x7fb2500945b0 secure :-1 s=READY pgs=2232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb28016e590 tx=0x7fb270009040 comp rx=0 tx=0).stop 2026-02-24T17:30:28.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb28014cff0 msgr2=0x7fb2800b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.091 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb28014cff0 0x7fb2800b7420 secure :-1 s=READY pgs=5157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb27c003920 tx=0x7fb27c00fd40 comp rx=0 tx=0).stop 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 shutdown_connections 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 --2- 10.20.193.40:0/3899344963 >> v2:10.20.193.120:6800/397309233 conn(0x7fb250074100 0x7fb2500945b0 unknown :-1 s=CLOSED pgs=2232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb28014cff0 0x7fb2800b7420 unknown :-1 s=CLOSED pgs=5157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb28015c680 0x7fb28014cab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 --2- 10.20.193.40:0/3899344963 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb26c0048d0 0x7fb28014c060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 >> 10.20.193.40:0/3899344963 conn(0x7fb2800b8fd0 msgr2=0x7fb280160bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 shutdown_connections 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 -- 10.20.193.40:0/3899344963 wait complete. 2026-02-24T17:30:28.092 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.091+0000 7fb286c31640 1 librados: shutdown 2026-02-24T17:30:28.100 INFO:tasks.ceph:Scrubbing osd.4 2026-02-24T17:30:28.100 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:28.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa36e3e5640 1 Processor -- start 2026-02-24T17:30:28.164 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa36e3e5640 1 -- start start 2026-02-24T17:30:28.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa36e3e5640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fa36815d0e0 0x7fa3680bb8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa36e3e5640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fa3680b4c10 0x7fa368056770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa36e3e5640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36816adc0 con 0x7fa36815d4b0 2026-02-24T17:30:28.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa36e3e5640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa368167670 con 0x7fa36815d0e0 2026-02-24T17:30:28.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa36e3e5640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fa368166a60 con 0x7fa3680b4c10 2026-02-24T17:30:28.165 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa367fff640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fa36815d0e0 0x7fa3680bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa36c95b640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fa3680b4c10 0x7fa368056770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa3677fe640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7fa36815d4b0 0x7fa3680b4500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:55886/0 (socket says 10.20.193.40:55886) 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.163+0000 7fa3677fe640 1 -- 10.20.193.40:0/1299936224 learned_addr learned my addr 10.20.193.40:0/1299936224 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa366ffd640 1 -- 10.20.193.40:0/1299936224 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712616750 0 0) 0x7fa36816adc0 con 0x7fa36815d4b0 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa366ffd640 1 -- 10.20.193.40:0/1299936224 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa34c003620 con 0x7fa36815d4b0 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa367fff640 1 -- 10.20.193.40:0/1299936224 >> v2:10.20.193.109:3300/0 conn(0x7fa3680b4c10 msgr2=0x7fa368056770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa367fff640 1 --2- 10.20.193.40:0/1299936224 >> v2:10.20.193.109:3300/0 conn(0x7fa3680b4c10 0x7fa368056770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa367fff640 1 -- 10.20.193.40:0/1299936224 >> v1:10.20.193.94:6789/0 conn(0x7fa36815d4b0 legacy=0x7fa3680b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.166 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa367fff640 1 -- 10.20.193.40:0/1299936224 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa368166d40 con 0x7fa36815d0e0 2026-02-24T17:30:28.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa367fff640 1 --2- 10.20.193.40:0/1299936224 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 0x7fa3680bb8e0 secure :-1 s=READY pgs=5182 gs=2 cs=0 l=1 c_cookie=8026988264332941946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3681677f0 tx=0x7fa35401c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f65974c2fcb5a7a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa366ffd640 1 -- 10.20.193.40:0/1299936224 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3540b0070 con 0x7fa36815d0e0 2026-02-24T17:30:28.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa366ffd640 1 -- 10.20.193.40:0/1299936224 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3540ab620 con 0x7fa36815d0e0 2026-02-24T17:30:28.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa366ffd640 1 -- 10.20.193.40:0/1299936224 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3540ab9f0 con 0x7fa36815d0e0 2026-02-24T17:30:28.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1299936224 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 msgr2=0x7fa3680bb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 --2- 10.20.193.40:0/1299936224 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 0x7fa3680bb8e0 secure :-1 s=READY pgs=5182 gs=2 cs=0 l=1 c_cookie=8026988264332941946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3681677f0 tx=0x7fa35401c520 comp rx=0 tx=0).stop 2026-02-24T17:30:28.167 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1299936224 shutdown_connections 2026-02-24T17:30:28.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 --2- 10.20.193.40:0/1299936224 >> v2:10.20.193.109:3300/0 conn(0x7fa3680b4c10 0x7fa368056770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 --2- 10.20.193.40:0/1299936224 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 0x7fa3680bb8e0 unknown :-1 s=CLOSED pgs=5182 gs=2 cs=0 l=1 c_cookie=8026988264332941946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1299936224 >> 10.20.193.40:0/1299936224 conn(0x7fa368054860 msgr2=0x7fa3680bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1299936224 shutdown_connections 2026-02-24T17:30:28.168 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1299936224 wait complete. 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 librados: starting msgr at 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 librados: starting objecter 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 Processor -- start 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- start start 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 librados: setting wanted keys 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 librados: calling monclient init 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa3680b4c10 0x7fa3680b8df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 0x7fa3680bc2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa36815d4b0 0x7fa36817a590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa36816a8d0 con 0x7fa36815d4b0 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa36816a750 con 0x7fa36815d0e0 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36e3e5640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fa36816aa50 con 0x7fa3680b4c10 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36c95b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa36815d4b0 0x7fa36817a590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa367fff640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa3680b4c10 0x7fa3680b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36c95b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa36815d4b0 0x7fa36817a590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57502/0 (socket says 10.20.193.40:57502) 2026-02-24T17:30:28.170 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa367fff640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa3680b4c10 0x7fa3680b8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:39660/0 (socket says 10.20.193.40:39660) 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36c95b640 1 -- 10.20.193.40:0/1891886342 learned_addr learned my addr 10.20.193.40:0/1891886342 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa3677fe640 1 --2- 10.20.193.40:0/1891886342 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 0x7fa3680bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36c95b640 1 -- 10.20.193.40:0/1891886342 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa3680b4c10 msgr2=0x7fa3680b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36c95b640 1 --2- 10.20.193.40:0/1891886342 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa3680b4c10 0x7fa3680b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36c95b640 1 -- 10.20.193.40:0/1891886342 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 msgr2=0x7fa3680bc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36c95b640 1 --2- 10.20.193.40:0/1891886342 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 0x7fa3680bc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa36c95b640 1 -- 10.20.193.40:0/1891886342 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3680b9590 con 0x7fa36815d4b0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.167+0000 7fa3677fe640 1 --2- 10.20.193.40:0/1891886342 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa36815d0e0 0x7fa3680bc2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36c95b640 1 --2- 10.20.193.40:0/1891886342 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa36815d4b0 0x7fa36817a590 secure :-1 s=READY pgs=5158 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa35c00fbf0 tx=0x7fa35c00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.?.objecter ms_handle_connect 0x7fa36815d4b0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa35c019030 con 0x7fa36815d4b0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35c00dd40 con 0x7fa36815d4b0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3680b9870 con 0x7fa36815d4b0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa35c0156a0 con 0x7fa36815d4b0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 10 client.25329.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3680b9e30 con 0x7fa36815d4b0 2026-02-24T17:30:28.171 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 1 librados: init done 2026-02-24T17:30:28.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 10 client.25329.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:28.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 15 client.25329.objecter _session_command_op_assign -1 1 2026-02-24T17:30:28.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 20 client.25329.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:28.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 10 client.25329.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.172 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa36805ca50 con 0x7fa36815d4b0 2026-02-24T17:30:28.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fa35c026060 con 0x7fa36815d4b0 2026-02-24T17:30:28.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 --2- 10.20.193.40:0/1891886342 >> v2:10.20.193.120:6800/397309233 conn(0x7fa338074100 0x7fa3380945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fa35c01a070 con 0x7fa36815d4b0 2026-02-24T17:30:28.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.25329.objecter ms_dispatch2 0x7fa368000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:28.173 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 3 client.25329.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 3 client.25329.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.25329.objecter checking command 1 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa367fff640 1 --2- 10.20.193.40:0/1891886342 >> v2:10.20.193.120:6800/397309233 conn(0x7fa338074100 0x7fa3380945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 --2- 10.20.193.40:0/1891886342 >> v2:10.20.193.40:6800/2818881548 conn(0x7fa33809b4a0 0x7fa3380bb930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 20 client.25329.objecter _get_session s=0x7fa33809adf0 osd=4 3 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 20 client.25329.objecter put_session s=0x7fa33809adf0 osd=4 3 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 15 client.25329.objecter _session_command_op_remove -1 1 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 20 client.25329.objecter _get_session s=0x7fa33809adf0 osd=4 3 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 20 client.25329.objecter get_session s=0x7fa33809adf0 osd=4 3 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 15 client.25329.objecter _session_command_op_assign 4 1 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 20 client.25329.objecter put_session s=0x7fa33809adf0 osd=4 4 2026-02-24T17:30:28.174 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.25329.objecter _send_command 1 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 --> v2:10.20.193.40:6800/2818881548 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa35c00a1c0 con 0x7fa33809b4a0 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 20 client.25329.objecter dump_active .. 0 homeless 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fa35c098b60 con 0x7fa36815d4b0 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa3677fe640 1 --2- 10.20.193.40:0/1891886342 >> v2:10.20.193.40:6800/2818881548 conn(0x7fa33809b4a0 0x7fa3380bb930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.25329.objecter ms_handle_connect 0x7fa33809b4a0 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa3677fe640 1 --2- 10.20.193.40:0/1891886342 >> v2:10.20.193.40:6800/2818881548 conn(0x7fa33809b4a0 0x7fa3380bb930 crc :-1 s=READY pgs=50 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 <== osd.4 v2:10.20.193.40:6800/2818881548 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fa35c00a1c0 con 0x7fa33809b4a0 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.25329.objecter ms_dispatch2 0x7fa368000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.25329.objecter _finish_command 1 = system:0 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 20 client.25329.objecter put_session s=0x7fa33809adf0 osd=4 4 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 15 client.25329.objecter _session_command_op_remove 4 1 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa367fff640 1 --2- 10.20.193.40:0/1891886342 >> v2:10.20.193.120:6800/397309233 conn(0x7fa338074100 0x7fa3380945b0 secure :-1 s=READY pgs=2233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa354002410 tx=0x7fa3540a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.175 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.171+0000 7fa364ff9640 10 client.25329.objecter ms_handle_connect 0x7fa338074100 2026-02-24T17:30:28.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 10 client.25329.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:28.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 15 client.25329.objecter _session_command_op_assign -1 2 2026-02-24T17:30:28.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 20 client.25329.objecter _get_session s=0x7fa33809adf0 osd=4 3 2026-02-24T17:30:28.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 20 client.25329.objecter put_session s=0x7fa33809adf0 osd=4 3 2026-02-24T17:30:28.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 20 client.25329.objecter _get_session s=0x7fa33809adf0 osd=4 3 2026-02-24T17:30:28.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 15 client.25329.objecter _session_command_op_remove -1 2 2026-02-24T17:30:28.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 20 client.25329.objecter get_session s=0x7fa33809adf0 osd=4 3 2026-02-24T17:30:28.180 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 15 client.25329.objecter _session_command_op_assign 4 2 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 20 client.25329.objecter put_session s=0x7fa33809adf0 osd=4 4 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 10 client.25329.objecter _send_command 2 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 --> v2:10.20.193.40:6800/2818881548 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa3680b9330 con 0x7fa33809b4a0 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa364ff9640 1 -- 10.20.193.40:0/1891886342 <== osd.4 v2:10.20.193.40:6800/2818881548 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa358002d30 con 0x7fa33809b4a0 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa364ff9640 10 client.25329.objecter ms_dispatch2 0x7fa368000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa364ff9640 10 client.25329.objecter _finish_command 2 = system:0 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa364ff9640 20 client.25329.objecter put_session s=0x7fa33809adf0 osd=4 4 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa364ff9640 15 client.25329.objecter _session_command_op_remove 4 2 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:28.181 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:28.182 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 10 librados: watch_flush enter 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 10 librados: watch_flush exit 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 10 client.25329.objecter close_session for osd.4 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 >> v2:10.20.193.40:6800/2818881548 conn(0x7fa33809b4a0 msgr2=0x7fa3380bb930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 --2- 10.20.193.40:0/1891886342 >> v2:10.20.193.40:6800/2818881548 conn(0x7fa33809b4a0 0x7fa3380bb930 crc :-1 s=READY pgs=50 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 20 client.25329.objecter put_session s=0x7fa33809adf0 osd=4 1 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 20 client.25329.objecter shutdown clearing up homeless session... 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 10 client.25329.objecter successfully canceled tick 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 >> v2:10.20.193.120:6800/397309233 conn(0x7fa338074100 msgr2=0x7fa3380945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 --2- 10.20.193.40:0/1891886342 >> v2:10.20.193.120:6800/397309233 conn(0x7fa338074100 0x7fa3380945b0 secure :-1 s=READY pgs=2233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa354002410 tx=0x7fa3540a6000 comp rx=0 tx=0).stop 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa36815d4b0 msgr2=0x7fa36817a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.183 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 --2- 10.20.193.40:0/1891886342 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa36815d4b0 0x7fa36817a590 secure :-1 s=READY pgs=5158 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa35c00fbf0 tx=0x7fa35c00d490 comp rx=0 tx=0).stop 2026-02-24T17:30:28.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36c95b640 1 -- 10.20.193.40:0/1891886342 reap_dead start 2026-02-24T17:30:28.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 shutdown_connections 2026-02-24T17:30:28.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 >> 10.20.193.40:0/1891886342 conn(0x7fa368054860 msgr2=0x7fa3680b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 shutdown_connections 2026-02-24T17:30:28.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 -- 10.20.193.40:0/1891886342 wait complete. 2026-02-24T17:30:28.184 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.179+0000 7fa36e3e5640 1 librados: shutdown 2026-02-24T17:30:28.189 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-24T17:30:28.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.247+0000 7f8f4771e640 1 Processor -- start 2026-02-24T17:30:28.249 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.247+0000 7f8f4771e640 1 -- start start 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f8f400b2500 0x7f8f400b28d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f8f400b3560 0x7f8f400b3cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f8f400b41f0 0x7f8f401607f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8f40166bb0 con 0x7f8f400b3560 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8f40167710 con 0x7f8f400b41f0 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f8f4016aed0 con 0x7f8f400b2500 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f8f400b3560 0x7f8f400b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f8f400b3560 0x7f8f400b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57516/0 (socket says 10.20.193.40:57516) 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 -- 10.20.193.40:0/3895918123 learned_addr learned my addr 10.20.193.40:0/3895918123 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f45493640 1 --2- 10.20.193.40:0/3895918123 >> v2:10.20.193.109:3300/0 conn(0x7f8f400b2500 0x7f8f400b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f45c94640 1 --2- 10.20.193.40:0/3895918123 >> v2:10.20.193.94:3300/0 conn(0x7f8f400b41f0 0x7f8f401607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 -- 10.20.193.40:0/3895918123 >> v2:10.20.193.109:3300/0 conn(0x7f8f400b2500 msgr2=0x7f8f400b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 --2- 10.20.193.40:0/3895918123 >> v2:10.20.193.109:3300/0 conn(0x7f8f400b2500 0x7f8f400b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 -- 10.20.193.40:0/3895918123 >> v2:10.20.193.94:3300/0 conn(0x7f8f400b41f0 msgr2=0x7f8f401607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 --2- 10.20.193.40:0/3895918123 >> v2:10.20.193.94:3300/0 conn(0x7f8f400b41f0 0x7f8f401607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.250 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 -- 10.20.193.40:0/3895918123 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f40166de0 con 0x7f8f400b3560 2026-02-24T17:30:28.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f44c92640 1 --2- 10.20.193.40:0/3895918123 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b3560 0x7f8f400b3cb0 secure :-1 s=READY pgs=5159 gs=1 cs=0 l=1 c_cookie=2916289491919229851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f4005b3b0 tx=0x7f8f3401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2878bdd77c0cd39b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f2ffff640 1 -- 10.20.193.40:0/3895918123 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f340b0070 con 0x7f8f400b3560 2026-02-24T17:30:28.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f2ffff640 1 -- 10.20.193.40:0/3895918123 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f340ab620 con 0x7f8f400b3560 2026-02-24T17:30:28.251 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f2ffff640 1 -- 10.20.193.40:0/3895918123 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f340aba10 con 0x7f8f400b3560 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 -- 10.20.193.40:0/3895918123 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b3560 msgr2=0x7f8f400b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 --2- 10.20.193.40:0/3895918123 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b3560 0x7f8f400b3cb0 secure :-1 s=READY pgs=5159 gs=1 cs=0 l=1 c_cookie=2916289491919229851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f4005b3b0 tx=0x7f8f3401c530 comp rx=0 tx=0).stop 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 -- 10.20.193.40:0/3895918123 shutdown_connections 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 --2- 10.20.193.40:0/3895918123 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b3560 0x7f8f400b3cb0 unknown :-1 s=CLOSED pgs=5159 gs=1 cs=0 l=1 c_cookie=2916289491919229851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 --2- 10.20.193.40:0/3895918123 >> v2:10.20.193.94:3300/0 conn(0x7f8f400b41f0 0x7f8f401607f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 --2- 10.20.193.40:0/3895918123 >> v2:10.20.193.109:3300/0 conn(0x7f8f400b2500 0x7f8f400b28d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 -- 10.20.193.40:0/3895918123 >> 10.20.193.40:0/3895918123 conn(0x7f8f400b8fd0 msgr2=0x7f8f400b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 -- 10.20.193.40:0/3895918123 shutdown_connections 2026-02-24T17:30:28.252 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.251+0000 7f8f4771e640 1 -- 10.20.193.40:0/3895918123 wait complete. 2026-02-24T17:30:28.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 librados: starting msgr at 2026-02-24T17:30:28.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 librados: starting objecter 2026-02-24T17:30:28.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 Processor -- start 2026-02-24T17:30:28.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 -- start start 2026-02-24T17:30:28.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 librados: setting wanted keys 2026-02-24T17:30:28.253 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 librados: calling monclient init 2026-02-24T17:30:28.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b2500 0x7f8f40142670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f400b3560 0x7f8f4017a6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f400b41f0 0x7f8f4013eee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400b3b10 con 0x7f8f400b2500 2026-02-24T17:30:28.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400b3990 con 0x7f8f400b41f0 2026-02-24T17:30:28.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4016a940 con 0x7f8f400b3560 2026-02-24T17:30:28.254 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b2500 0x7f8f40142670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b2500 0x7f8f40142670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57532/0 (socket says 10.20.193.40:57532) 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 -- 10.20.193.40:0/613421910 learned_addr learned my addr 10.20.193.40:0/613421910 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45c94640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f400b41f0 0x7f8f4013eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f44c92640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f400b3560 0x7f8f4017a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 -- 10.20.193.40:0/613421910 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f400b3560 msgr2=0x7f8f4017a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f400b3560 0x7f8f4017a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 -- 10.20.193.40:0/613421910 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f400b41f0 msgr2=0x7f8f4013eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f400b41f0 0x7f8f4013eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 -- 10.20.193.40:0/613421910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f40141030 con 0x7f8f400b2500 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f44c92640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f400b3560 0x7f8f4017a6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f45493640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b2500 0x7f8f40142670 secure :-1 s=READY pgs=5160 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f30006b80 tx=0x7f8f3000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 10 client.?.objecter ms_handle_connect 0x7f8f400b2500 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 1 -- 10.20.193.40:0/613421910 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f30018020 con 0x7f8f400b2500 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 1 -- 10.20.193.40:0/613421910 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3000de50 con 0x7f8f400b2500 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f401412f0 con 0x7f8f400b2500 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 1 -- 10.20.193.40:0/613421910 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f3000bd50 con 0x7f8f400b2500 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 10 client.25335.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f401418b0 con 0x7f8f400b2500 2026-02-24T17:30:28.255 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 librados: init done 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f400b3cb0 con 0x7f8f400b2500 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 1 -- 10.20.193.40:0/613421910 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f8f30013050 con 0x7f8f400b2500 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 1 --2- 10.20.193.40:0/613421910 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f10074100 0x7f8f100945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 1 -- 10.20.193.40:0/613421910 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f8f3000f040 con 0x7f8f400b2500 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 10 client.25335.objecter ms_dispatch2 0x7f8f40000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 3 client.25335.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 3 client.25335.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 20 client.25335.objecter dump_active .. 0 homeless 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f44c92640 1 --2- 10.20.193.40:0/613421910 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f10074100 0x7f8f100945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f44c92640 1 --2- 10.20.193.40:0/613421910 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f10074100 0x7f8f100945b0 secure :-1 s=READY pgs=2234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f3401abe0 tx=0x7f8f34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.255+0000 7f8f2dffb640 10 client.25335.objecter ms_handle_connect 0x7f8f10074100 2026-02-24T17:30:28.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.259+0000 7f8f2dffb640 1 -- 10.20.193.40:0/613421910 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f8f30022020 con 0x7f8f400b2500 2026-02-24T17:30:28.348 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8f40164560 con 0x7f8f10074100 2026-02-24T17:30:28.349 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f2dffb640 1 -- 10.20.193.40:0/613421910 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8f40164560 con 0x7f8f10074100 2026-02-24T17:30:28.349 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 4 to deep-scrub 2026-02-24T17:30:28.350 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 10 librados: watch_flush enter 2026-02-24T17:30:28.350 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 10 librados: watch_flush exit 2026-02-24T17:30:28.350 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 20 client.25335.objecter shutdown clearing up homeless session... 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 10 client.25335.objecter successfully canceled tick 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f10074100 msgr2=0x7f8f100945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 1 --2- 10.20.193.40:0/613421910 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f10074100 0x7f8f100945b0 secure :-1 s=READY pgs=2234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f3401abe0 tx=0x7f8f34008040 comp rx=0 tx=0).stop 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b2500 msgr2=0x7f8f40142670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.347+0000 7f8f4771e640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b2500 0x7f8f40142670 secure :-1 s=READY pgs=5160 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f30006b80 tx=0x7f8f3000dc60 comp rx=0 tx=0).stop 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 shutdown_connections 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 --2- 10.20.193.40:0/613421910 >> v2:10.20.193.120:6800/397309233 conn(0x7f8f10074100 0x7f8f100945b0 unknown :-1 s=CLOSED pgs=2234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f8f400b41f0 0x7f8f4013eee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f8f400b3560 0x7f8f4017a6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.351 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 --2- 10.20.193.40:0/613421910 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f8f400b2500 0x7f8f40142670 unknown :-1 s=CLOSED pgs=5160 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.352 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 >> 10.20.193.40:0/613421910 conn(0x7f8f400b8fd0 msgr2=0x7f8f401660c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.352 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 shutdown_connections 2026-02-24T17:30:28.352 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 -- 10.20.193.40:0/613421910 wait complete. 2026-02-24T17:30:28.352 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.351+0000 7f8f4771e640 1 librados: shutdown 2026-02-24T17:30:28.360 INFO:tasks.ceph:Scrubbing osd.8 2026-02-24T17:30:28.360 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:28.423 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c86d2640 1 Processor -- start 2026-02-24T17:30:28.424 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c86d2640 1 -- start start 2026-02-24T17:30:28.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c86d2640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7fb5c016a210 0x7fb5c016a5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c86d2640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fb5c00b5920 0x7fb5c0167eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c86d2640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c00b61c0 con 0x7fb5c015cea0 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c86d2640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c00b64a0 con 0x7fb5c00b5920 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c86d2640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c00b6780 con 0x7fb5c016a210 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5c46640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fb5c00b5920 0x7fb5c0167eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5c46640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fb5c00b5920 0x7fb5c0167eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57534/0 (socket says 10.20.193.40:57534) 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c6c48640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fb5c015cea0 0x7fb5c015d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34450/0 (socket says 10.20.193.40:34450) 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5c46640 1 -- 10.20.193.40:0/124841334 learned_addr learned my addr 10.20.193.40:0/124841334 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c6447640 1 --2- 10.20.193.40:0/124841334 >> v2:10.20.193.109:3300/0 conn(0x7fb5c016a210 0x7fb5c016a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5445640 1 -- 10.20.193.40:0/124841334 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3121105090 0 0) 0x7fb5c00b61c0 con 0x7fb5c015cea0 2026-02-24T17:30:28.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5445640 1 -- 10.20.193.40:0/124841334 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5a8003620 con 0x7fb5c015cea0 2026-02-24T17:30:28.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5c46640 1 -- 10.20.193.40:0/124841334 >> v2:10.20.193.109:3300/0 conn(0x7fb5c016a210 msgr2=0x7fb5c016a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5c46640 1 --2- 10.20.193.40:0/124841334 >> v2:10.20.193.109:3300/0 conn(0x7fb5c016a210 0x7fb5c016a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5c46640 1 -- 10.20.193.40:0/124841334 >> v1:10.20.193.40:6789/0 conn(0x7fb5c015cea0 legacy=0x7fb5c015d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.423+0000 7fb5c5c46640 1 -- 10.20.193.40:0/124841334 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c00b6a60 con 0x7fb5c00b5920 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 --2- 10.20.193.40:0/124841334 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c00b5920 0x7fb5c0167eb0 secure :-1 s=READY pgs=5162 gs=2 cs=0 l=1 c_cookie=9364384145094053339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5c005c1a0 tx=0x7fb5b401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f4f9c3eca18ddb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5445640 1 -- 10.20.193.40:0/124841334 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5b40b0620 con 0x7fb5c00b5920 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5445640 1 -- 10.20.193.40:0/124841334 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b40b07c0 con 0x7fb5c00b5920 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5445640 1 -- 10.20.193.40:0/124841334 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5b40b0bb0 con 0x7fb5c00b5920 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- 10.20.193.40:0/124841334 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c00b5920 msgr2=0x7fb5c0167eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 --2- 10.20.193.40:0/124841334 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c00b5920 0x7fb5c0167eb0 secure :-1 s=READY pgs=5162 gs=2 cs=0 l=1 c_cookie=9364384145094053339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5c005c1a0 tx=0x7fb5b401c5d0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- 10.20.193.40:0/124841334 shutdown_connections 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 --2- 10.20.193.40:0/124841334 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c00b5920 0x7fb5c0167eb0 unknown :-1 s=CLOSED pgs=5162 gs=2 cs=0 l=1 c_cookie=9364384145094053339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.432 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 --2- 10.20.193.40:0/124841334 >> v2:10.20.193.109:3300/0 conn(0x7fb5c016a210 0x7fb5c016a5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- 10.20.193.40:0/124841334 >> 10.20.193.40:0/124841334 conn(0x7fb5c00bb460 msgr2=0x7fb5c00b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- 10.20.193.40:0/124841334 shutdown_connections 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- 10.20.193.40:0/124841334 wait complete. 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 librados: starting msgr at 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 librados: starting objecter 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 Processor -- start 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- start start 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 librados: setting wanted keys 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 librados: calling monclient init 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb5c00b5920 0x7fb5c0139aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c015cea0 0x7fb5c0134fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.433 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb5c016a210 0x7fb5c00b8dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c00b5ee0 con 0x7fb5c015cea0 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c00b5d60 con 0x7fb5c00b5920 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c01683f0 con 0x7fb5c016a210 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c015cea0 0x7fb5c0134fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c015cea0 0x7fb5c0134fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57538/0 (socket says 10.20.193.40:57538) 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 -- 10.20.193.40:0/4056848116 learned_addr learned my addr 10.20.193.40:0/4056848116 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c6447640 1 --2- 10.20.193.40:0/4056848116 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb5c00b5920 0x7fb5c0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c6c48640 1 --2- 10.20.193.40:0/4056848116 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb5c016a210 0x7fb5c00b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 -- 10.20.193.40:0/4056848116 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb5c016a210 msgr2=0x7fb5c00b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 --2- 10.20.193.40:0/4056848116 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fb5c016a210 0x7fb5c00b8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 -- 10.20.193.40:0/4056848116 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb5c00b5920 msgr2=0x7fb5c0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 --2- 10.20.193.40:0/4056848116 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fb5c00b5920 0x7fb5c0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 -- 10.20.193.40:0/4056848116 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c0136080 con 0x7fb5c015cea0 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c5c46640 1 --2- 10.20.193.40:0/4056848116 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c015cea0 0x7fb5c0134fd0 secure :-1 s=READY pgs=5163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5b40b0a30 tx=0x7fb5b401ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5a6ffd640 10 client.?.objecter ms_handle_connect 0x7fb5c015cea0 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5a6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5b4004240 con 0x7fb5c015cea0 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b40043e0 con 0x7fb5c015cea0 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5b4003930 con 0x7fb5c015cea0 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c0179650 con 0x7fb5c015cea0 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 10 client.25344.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c0134230 con 0x7fb5c015cea0 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 librados: init done 2026-02-24T17:30:28.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 10 client.25344.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 15 client.25344.objecter _session_command_op_assign -1 1 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 20 client.25344.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 10 client.25344.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.427+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5c0134c30 con 0x7fb5c015cea0 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fb5b4003ad0 con 0x7fb5c015cea0 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 1 --2- 10.20.193.40:0/4056848116 >> v2:10.20.193.120:6800/397309233 conn(0x7fb590074100 0x7fb5900945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fb5b40bd020 con 0x7fb5c015cea0 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 10 client.25344.objecter ms_dispatch2 0x7fb5c0000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 3 client.25344.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 3 client.25344.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 10 client.25344.objecter checking command 1 2026-02-24T17:30:28.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 1 --2- 10.20.193.40:0/4056848116 >> v2:10.20.193.40:6808/1991872075 conn(0x7fb59009b440 0x7fb5900bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 20 client.25344.objecter _get_session s=0x7fb59009ad90 osd=8 3 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 20 client.25344.objecter put_session s=0x7fb59009ad90 osd=8 3 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 15 client.25344.objecter _session_command_op_remove -1 1 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 20 client.25344.objecter _get_session s=0x7fb59009ad90 osd=8 3 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 20 client.25344.objecter get_session s=0x7fb59009ad90 osd=8 3 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 15 client.25344.objecter _session_command_op_assign 8 1 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 20 client.25344.objecter put_session s=0x7fb59009ad90 osd=8 4 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 10 client.25344.objecter _send_command 1 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 --> v2:10.20.193.40:6808/1991872075 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5b40c0e50 con 0x7fb59009b440 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 20 client.25344.objecter dump_active .. 0 homeless 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fb5b4131640 con 0x7fb5c015cea0 2026-02-24T17:30:28.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5c6447640 1 --2- 10.20.193.40:0/4056848116 >> v2:10.20.193.120:6800/397309233 conn(0x7fb590074100 0x7fb5900945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5c6c48640 1 --2- 10.20.193.40:0/4056848116 >> v2:10.20.193.40:6808/1991872075 conn(0x7fb59009b440 0x7fb5900bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 10 client.25344.objecter ms_handle_connect 0x7fb59009b440 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5c6c48640 1 --2- 10.20.193.40:0/4056848116 >> v2:10.20.193.40:6808/1991872075 conn(0x7fb59009b440 0x7fb5900bb8d0 crc :-1 s=READY pgs=66 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 10 client.25344.objecter ms_handle_connect 0x7fb590074100 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5c6447640 1 --2- 10.20.193.40:0/4056848116 >> v2:10.20.193.120:6800/397309233 conn(0x7fb590074100 0x7fb5900945b0 secure :-1 s=READY pgs=2235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5b0004780 tx=0x7fb5b0009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 <== osd.8 v2:10.20.193.40:6808/1991872075 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fb5b40c0e50 con 0x7fb59009b440 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 10 client.25344.objecter ms_dispatch2 0x7fb5c0000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 10 client.25344.objecter _finish_command 1 = system:0 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 20 client.25344.objecter put_session s=0x7fb59009ad90 osd=8 4 2026-02-24T17:30:28.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.431+0000 7fb5a6ffd640 15 client.25344.objecter _session_command_op_remove 8 1 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 10 client.25344.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 15 client.25344.objecter _session_command_op_assign -1 2 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 20 client.25344.objecter _get_session s=0x7fb59009ad90 osd=8 3 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 20 client.25344.objecter put_session s=0x7fb59009ad90 osd=8 3 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 20 client.25344.objecter _get_session s=0x7fb59009ad90 osd=8 3 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 15 client.25344.objecter _session_command_op_remove -1 2 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 20 client.25344.objecter get_session s=0x7fb59009ad90 osd=8 3 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 15 client.25344.objecter _session_command_op_assign 8 2 2026-02-24T17:30:28.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 20 client.25344.objecter put_session s=0x7fb59009ad90 osd=8 4 2026-02-24T17:30:28.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 10 client.25344.objecter _send_command 2 2026-02-24T17:30:28.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 --> v2:10.20.193.40:6808/1991872075 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb5c005da40 con 0x7fb59009b440 2026-02-24T17:30:28.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5a6ffd640 1 -- 10.20.193.40:0/4056848116 <== osd.8 v2:10.20.193.40:6808/1991872075 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb5bc013320 con 0x7fb59009b440 2026-02-24T17:30:28.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5a6ffd640 10 client.25344.objecter ms_dispatch2 0x7fb5c0000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:28.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5a6ffd640 10 client.25344.objecter _finish_command 2 = system:0 2026-02-24T17:30:28.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5a6ffd640 20 client.25344.objecter put_session s=0x7fb59009ad90 osd=8 4 2026-02-24T17:30:28.441 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5a6ffd640 15 client.25344.objecter _session_command_op_remove 8 2 2026-02-24T17:30:28.441 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:28.442 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:28.442 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:28.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 10 librados: watch_flush enter 2026-02-24T17:30:28.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 10 librados: watch_flush exit 2026-02-24T17:30:28.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 10 client.25344.objecter close_session for osd.8 2026-02-24T17:30:28.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 >> v2:10.20.193.40:6808/1991872075 conn(0x7fb59009b440 msgr2=0x7fb5900bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 --2- 10.20.193.40:0/4056848116 >> v2:10.20.193.40:6808/1991872075 conn(0x7fb59009b440 0x7fb5900bb8d0 crc :-1 s=READY pgs=66 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 20 client.25344.objecter put_session s=0x7fb59009ad90 osd=8 1 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 20 client.25344.objecter shutdown clearing up homeless session... 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 10 client.25344.objecter successfully canceled tick 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 >> v2:10.20.193.120:6800/397309233 conn(0x7fb590074100 msgr2=0x7fb5900945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 --2- 10.20.193.40:0/4056848116 >> v2:10.20.193.120:6800/397309233 conn(0x7fb590074100 0x7fb5900945b0 secure :-1 s=READY pgs=2235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5b0004780 tx=0x7fb5b0009290 comp rx=0 tx=0).stop 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c015cea0 msgr2=0x7fb5c0134fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 --2- 10.20.193.40:0/4056848116 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fb5c015cea0 0x7fb5c0134fd0 secure :-1 s=READY pgs=5163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5b40b0a30 tx=0x7fb5b401ae10 comp rx=0 tx=0).stop 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c6c48640 1 -- 10.20.193.40:0/4056848116 reap_dead start 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 shutdown_connections 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 >> 10.20.193.40:0/4056848116 conn(0x7fb5c00bb460 msgr2=0x7fb5c015d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 shutdown_connections 2026-02-24T17:30:28.445 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 -- 10.20.193.40:0/4056848116 wait complete. 2026-02-24T17:30:28.445 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.439+0000 7fb5c86d2640 1 librados: shutdown 2026-02-24T17:30:28.448 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-24T17:30:28.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.507+0000 7f7f37b96640 1 Processor -- start 2026-02-24T17:30:28.508 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.507+0000 7f7f37b96640 1 -- start start 2026-02-24T17:30:28.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f7f30161c70 0x7f7f300b3890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f7f3016ba90 0x7f7f300b22a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3016e870 con 0x7f7f301618a0 2026-02-24T17:30:28.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f7f3016e620 con 0x7f7f3016ba90 2026-02-24T17:30:28.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f7f3016eb50 con 0x7f7f30161c70 2026-02-24T17:30:28.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f7f301618a0 0x7f7f3016b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34454/0 (socket says 10.20.193.40:34454) 2026-02-24T17:30:28.509 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 -- 10.20.193.40:0/1402087534 learned_addr learned my addr 10.20.193.40:0/1402087534 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3610c640 1 --2- 10.20.193.40:0/1402087534 >> v2:10.20.193.94:3300/0 conn(0x7f7f3016ba90 0x7f7f300b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3510a640 1 --2- 10.20.193.40:0/1402087534 >> v2:10.20.193.109:3300/0 conn(0x7f7f30161c70 0x7f7f300b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260463687 0 0) 0x7f7f3016e870 con 0x7f7f301618a0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f18003620 con 0x7f7f301618a0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1014202854 0 0) 0x7f7f18003620 con 0x7f7f301618a0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 >> v2:10.20.193.109:3300/0 conn(0x7f7f30161c70 msgr2=0x7f7f300b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 --2- 10.20.193.40:0/1402087534 >> v2:10.20.193.109:3300/0 conn(0x7f7f30161c70 0x7f7f300b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 >> v2:10.20.193.94:3300/0 conn(0x7f7f3016ba90 msgr2=0x7f7f300b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 --2- 10.20.193.40:0/1402087534 >> v2:10.20.193.94:3300/0 conn(0x7f7f3016ba90 0x7f7f300b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3016ee30 con 0x7f7f301618a0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f7f20002e80 con 0x7f7f301618a0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 >> v1:10.20.193.40:6789/0 conn(0x7f7f301618a0 legacy=0x7f7f3016b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f18003ba0 0x7f7f18003fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f180048d0 0x7f7f18004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f18005280 0x7f7f18065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3016e620 con 0x7f7f18003ba0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3016eb50 con 0x7f7f18005280 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7f18066290 con 0x7f7f180048d0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f18003ba0 0x7f7f18003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3510a640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f180048d0 0x7f7f18004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3610c640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f18005280 0x7f7f18065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 -- 10.20.193.40:0/1402087534 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f180048d0 msgr2=0x7f7f18004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f180048d0 0x7f7f18004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 -- 10.20.193.40:0/1402087534 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f18005280 msgr2=0x7f7f18065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f18005280 0x7f7f18065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 -- 10.20.193.40:0/1402087534 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f18003620 con 0x7f7f18003ba0 2026-02-24T17:30:28.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3610c640 1 -- 10.20.193.40:0/1402087534 reap_dead start 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f3590b640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f18003ba0 0x7f7f18003fb0 secure :-1 s=READY pgs=5165 gs=4 cs=0 l=1 c_cookie=11276927720413719867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f20003270 tx=0x7f7f2001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7fb2039503ed3b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f20007db0 con 0x7f7f18003ba0 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f200a9020 con 0x7f7f18003ba0 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f34909640 1 -- 10.20.193.40:0/1402087534 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f20005e50 con 0x7f7f18003ba0 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- 10.20.193.40:0/1402087534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f18003ba0 msgr2=0x7f7f18003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f18003ba0 0x7f7f18003fb0 secure :-1 s=READY pgs=5165 gs=4 cs=0 l=1 c_cookie=11276927720413719867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f20003270 tx=0x7f7f2001cc10 comp rx=0 tx=0).stop 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- 10.20.193.40:0/1402087534 shutdown_connections 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 --2- 10.20.193.40:0/1402087534 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f18003ba0 0x7f7f18003fb0 unknown :-1 s=CLOSED pgs=5165 gs=4 cs=0 l=1 c_cookie=11276927720413719867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- 10.20.193.40:0/1402087534 >> 10.20.193.40:0/1402087534 conn(0x7f7f300b8fd0 msgr2=0x7f7f300b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- 10.20.193.40:0/1402087534 shutdown_connections 2026-02-24T17:30:28.511 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- 10.20.193.40:0/1402087534 wait complete. 2026-02-24T17:30:28.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 librados: starting msgr at 2026-02-24T17:30:28.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 librados: starting objecter 2026-02-24T17:30:28.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 Processor -- start 2026-02-24T17:30:28.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 -- start start 2026-02-24T17:30:28.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 librados: setting wanted keys 2026-02-24T17:30:28.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.511+0000 7f7f37b96640 1 librados: calling monclient init 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f18003ba0 0x7f7f30169e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f30130430 0x7f7f30057ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f300b71c0 0x7f7f30056320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7f300b2c30 con 0x7f7f300b71c0 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f7f300b2ab0 con 0x7f7f30130430 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f7f300b3ef0 con 0x7f7f18003ba0 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3610c640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f300b71c0 0x7f7f30056320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3610c640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f300b71c0 0x7f7f30056320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57562/0 (socket says 10.20.193.40:57562) 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3510a640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f30130430 0x7f7f30057ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3610c640 1 -- 10.20.193.40:0/2941730958 learned_addr learned my addr 10.20.193.40:0/2941730958 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3590b640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f18003ba0 0x7f7f30169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3510a640 1 -- 10.20.193.40:0/2941730958 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f18003ba0 msgr2=0x7f7f30169e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3510a640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f18003ba0 0x7f7f30169e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3510a640 1 -- 10.20.193.40:0/2941730958 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f300b71c0 msgr2=0x7f7f30056320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3510a640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f300b71c0 0x7f7f30056320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3510a640 1 -- 10.20.193.40:0/2941730958 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f30057050 con 0x7f7f30130430 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3610c640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f300b71c0 0x7f7f30056320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3510a640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f30130430 0x7f7f30057ac0 secure :-1 s=READY pgs=5183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f2400f4c0 tx=0x7f7f2400f980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 10 client.?.objecter ms_handle_connect 0x7f7f30130430 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 1 -- 10.20.193.40:0/2941730958 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f24018020 con 0x7f7f30130430 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f30169040 con 0x7f7f30130430 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 10 client.25840.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f30169600 con 0x7f7f30130430 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 1 -- 10.20.193.40:0/2941730958 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f240148b0 con 0x7f7f30130430 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 1 -- 10.20.193.40:0/2941730958 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f24014c80 con 0x7f7f30130430 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 librados: init done 2026-02-24T17:30:28.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f300b4280 con 0x7f7f30130430 2026-02-24T17:30:28.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 1 -- 10.20.193.40:0/2941730958 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f7f2401d400 con 0x7f7f30130430 2026-02-24T17:30:28.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 1 --2- 10.20.193.40:0/2941730958 >> v2:10.20.193.120:6800/397309233 conn(0x7f7f000740f0 0x7f7f000945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 1 -- 10.20.193.40:0/2941730958 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f7f24096d80 con 0x7f7f30130430 2026-02-24T17:30:28.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 10 client.25840.objecter ms_dispatch2 0x7f7f30000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:28.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 3 client.25840.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:28.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 3 client.25840.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:28.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3590b640 1 --2- 10.20.193.40:0/2941730958 >> v2:10.20.193.120:6800/397309233 conn(0x7f7f000740f0 0x7f7f000945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 20 client.25840.objecter dump_active .. 0 homeless 2026-02-24T17:30:28.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f3590b640 1 --2- 10.20.193.40:0/2941730958 >> v2:10.20.193.120:6800/397309233 conn(0x7f7f000740f0 0x7f7f000945a0 secure :-1 s=READY pgs=2236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f2001cc50 tx=0x7f7f200b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.515+0000 7f7f1e7fc640 10 client.25840.objecter ms_handle_connect 0x7f7f000740f0 2026-02-24T17:30:28.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.519+0000 7f7f1e7fc640 1 -- 10.20.193.40:0/2941730958 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f7f24022020 con 0x7f7f30130430 2026-02-24T17:30:28.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f7f300b9550 con 0x7f7f000740f0 2026-02-24T17:30:28.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f1e7fc640 1 -- 10.20.193.40:0/2941730958 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7f300b9550 con 0x7f7f000740f0 2026-02-24T17:30:28.605 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 8 to deep-scrub 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 10 librados: watch_flush enter 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 10 librados: watch_flush exit 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 20 client.25840.objecter shutdown clearing up homeless session... 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 10 client.25840.objecter successfully canceled tick 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 >> v2:10.20.193.120:6800/397309233 conn(0x7f7f000740f0 msgr2=0x7f7f000945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 --2- 10.20.193.40:0/2941730958 >> v2:10.20.193.120:6800/397309233 conn(0x7f7f000740f0 0x7f7f000945a0 secure :-1 s=READY pgs=2236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f2001cc50 tx=0x7f7f200b1040 comp rx=0 tx=0).stop 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f30130430 msgr2=0x7f7f30057ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f30130430 0x7f7f30057ac0 secure :-1 s=READY pgs=5183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f2400f4c0 tx=0x7f7f2400f980 comp rx=0 tx=0).stop 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 shutdown_connections 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 --2- 10.20.193.40:0/2941730958 >> v2:10.20.193.120:6800/397309233 conn(0x7f7f000740f0 0x7f7f000945a0 unknown :-1 s=CLOSED pgs=2236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f7f300b71c0 0x7f7f30056320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f7f30130430 0x7f7f30057ac0 unknown :-1 s=CLOSED pgs=5183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 --2- 10.20.193.40:0/2941730958 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f7f18003ba0 0x7f7f30169e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 >> 10.20.193.40:0/2941730958 conn(0x7f7f300b8fd0 msgr2=0x7f7f300b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 shutdown_connections 2026-02-24T17:30:28.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 -- 10.20.193.40:0/2941730958 wait complete. 2026-02-24T17:30:28.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.607+0000 7f7f37b96640 1 librados: shutdown 2026-02-24T17:30:28.617 INFO:tasks.ceph:Scrubbing osd.12 2026-02-24T17:30:28.617 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:28.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec5183b640 1 Processor -- start 2026-02-24T17:30:28.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec5183b640 1 -- start start 2026-02-24T17:30:28.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec5183b640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fec4c161700 0x7fec4c16af20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec5183b640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec4c0b3560 con 0x7fec4c161ad0 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec5183b640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec4c16b750 con 0x7fec4c0b3fd0 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec5183b640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fec4c0b3b40 con 0x7fec4c161700 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4a7fc640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fec4c161ad0 0x7fec4c0b16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34464/0 (socket says 10.20.193.40:34464) 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4a7fc640 1 -- 10.20.193.40:0/719228134 learned_addr learned my addr 10.20.193.40:0/719228134 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4affd640 1 --2- 10.20.193.40:0/719228134 >> v2:10.20.193.94:3300/0 conn(0x7fec4c161700 0x7fec4c16af20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237526631 0 0) 0x7fec4c0b3560 con 0x7fec4c161ad0 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec38003620 con 0x7fec4c161ad0 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 531040581 0 0) 0x7fec38003620 con 0x7fec4c161ad0 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 >> v2:10.20.193.94:3300/0 conn(0x7fec4c161700 msgr2=0x7fec4c16af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 --2- 10.20.193.40:0/719228134 >> v2:10.20.193.94:3300/0 conn(0x7fec4c161700 0x7fec4c16af20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 >> v1:10.20.193.94:6789/0 conn(0x7fec4c0b3fd0 legacy=0x7fec4c0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c16ba30 con 0x7fec4c161ad0 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7fec34002e80 con 0x7fec4c161ad0 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 >> v1:10.20.193.40:6789/0 conn(0x7fec4c161ad0 legacy=0x7fec4c0b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec38003ba0 0x7fec38003fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec380048d0 0x7fec38004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fec380052d0 0x7fec38065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0b3b40 con 0x7fec38003ba0 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fec380661e0 con 0x7fec380048d0 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fec380663e0 con 0x7fec380052d0 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4affd640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec38003ba0 0x7fec38003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4a7fc640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec380048d0 0x7fec38004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4b7fe640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fec380052d0 0x7fec38065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4affd640 1 -- 10.20.193.40:0/719228134 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fec380052d0 msgr2=0x7fec38065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4affd640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fec380052d0 0x7fec38065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4affd640 1 -- 10.20.193.40:0/719228134 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec380048d0 msgr2=0x7fec38004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4affd640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec380048d0 0x7fec38004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4b7fe640 1 -- 10.20.193.40:0/719228134 reap_dead start 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4affd640 1 -- 10.20.193.40:0/719228134 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec38003620 con 0x7fec38003ba0 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec4affd640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec38003ba0 0x7fec38003fb0 secure :-1 s=READY pgs=5167 gs=4 cs=0 l=1 c_cookie=3104454372835289956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec40009af0 tx=0x7fec4001cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b153ccdd2416b64 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec400b2070 con 0x7fec38003ba0 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec400a5840 con 0x7fec38003ba0 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec49ffb640 1 -- 10.20.193.40:0/719228134 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec400096f0 con 0x7fec38003ba0 2026-02-24T17:30:28.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec5183b640 1 -- 10.20.193.40:0/719228134 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec38003ba0 msgr2=0x7fec38003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.689 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.683+0000 7fec5183b640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec38003ba0 0x7fec38003fb0 secure :-1 s=READY pgs=5167 gs=4 cs=0 l=1 c_cookie=3104454372835289956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec40009af0 tx=0x7fec4001cae0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.689 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- 10.20.193.40:0/719228134 shutdown_connections 2026-02-24T17:30:28.689 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 --2- 10.20.193.40:0/719228134 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec38003ba0 0x7fec38003fb0 unknown :-1 s=CLOSED pgs=5167 gs=4 cs=0 l=1 c_cookie=3104454372835289956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.689 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- 10.20.193.40:0/719228134 >> 10.20.193.40:0/719228134 conn(0x7fec4c0b58a0 msgr2=0x7fec4c0b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.689 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- 10.20.193.40:0/719228134 shutdown_connections 2026-02-24T17:30:28.689 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- 10.20.193.40:0/719228134 wait complete. 2026-02-24T17:30:28.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 librados: starting msgr at 2026-02-24T17:30:28.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 librados: starting objecter 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 Processor -- start 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- start start 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 librados: setting wanted keys 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 librados: calling monclient init 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fec38003ba0 0x7fec4c209d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec4c20a240 0x7fec4c208060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec4c056f10 0x7fec4c2085a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0b47b0 con 0x7fec4c056f10 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0b1eb0 con 0x7fec4c20a240 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0b4930 con 0x7fec38003ba0 2026-02-24T17:30:28.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec4c056f10 0x7fec4c2085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec4c056f10 0x7fec4c2085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57578/0 (socket says 10.20.193.40:57578) 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 -- 10.20.193.40:0/3459905373 learned_addr learned my addr 10.20.193.40:0/3459905373 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4a7fc640 1 --2- 10.20.193.40:0/3459905373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec4c20a240 0x7fec4c208060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4affd640 1 --2- 10.20.193.40:0/3459905373 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fec38003ba0 0x7fec4c209d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4a7fc640 1 -- 10.20.193.40:0/3459905373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec4c20a240 msgr2=0x7fec4c208060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4a7fc640 1 -- 10.20.193.40:0/3459905373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec4c20a240 msgr2=0x7fec4c208060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4a7fc640 1 --2- 10.20.193.40:0/3459905373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec4c20a240 0x7fec4c208060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4a7fc640 1 --2- 10.20.193.40:0/3459905373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec4c20a240 0x7fec4c208060 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 -- 10.20.193.40:0/3459905373 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fec38003ba0 msgr2=0x7fec4c209d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 --2- 10.20.193.40:0/3459905373 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fec38003ba0 0x7fec4c209d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 -- 10.20.193.40:0/3459905373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec4c20a240 msgr2=0x7fec4c208060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T17:30:28.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 --2- 10.20.193.40:0/3459905373 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fec4c20a240 0x7fec4c208060 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 -- 10.20.193.40:0/3459905373 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c160ae0 con 0x7fec4c056f10 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec4b7fe640 1 --2- 10.20.193.40:0/3459905373 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec4c056f10 0x7fec4c2085a0 secure :-1 s=READY pgs=5168 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec3c003fe0 tx=0x7fec3c0066a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec23fff640 10 client.?.objecter ms_handle_connect 0x7fec4c056f10 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec23fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec3c014610 con 0x7fec4c056f10 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c019070 con 0x7fec4c056f10 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec3c014a10 con 0x7fec4c056f10 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c057490 con 0x7fec4c056f10 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 10 client.25356.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c057a50 con 0x7fec4c056f10 2026-02-24T17:30:28.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 librados: init done 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 10 client.25356.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 15 client.25356.objecter _session_command_op_assign -1 1 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 20 client.25356.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 10 client.25356.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.687+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec4c16b330 con 0x7fec4c056f10 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fec3c014bb0 con 0x7fec4c056f10 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 1 --2- 10.20.193.40:0/3459905373 >> v2:10.20.193.120:6800/397309233 conn(0x7fec1c0740f0 0x7fec1c0945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fec3c011040 con 0x7fec4c056f10 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 10 client.25356.objecter ms_dispatch2 0x7fec4c000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 3 client.25356.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 3 client.25356.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:28.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 10 client.25356.objecter checking command 1 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec4affd640 1 --2- 10.20.193.40:0/3459905373 >> v2:10.20.193.120:6800/397309233 conn(0x7fec1c0740f0 0x7fec1c0945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 1 --2- 10.20.193.40:0/3459905373 >> v2:10.20.193.40:6812/730213184 conn(0x7fec1c09b430 0x7fec1c0bb8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 20 client.25356.objecter _get_session s=0x7fec1c09ad80 osd=12 3 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 20 client.25356.objecter put_session s=0x7fec1c09ad80 osd=12 3 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 15 client.25356.objecter _session_command_op_remove -1 1 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 20 client.25356.objecter _get_session s=0x7fec1c09ad80 osd=12 3 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 20 client.25356.objecter get_session s=0x7fec1c09ad80 osd=12 3 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 15 client.25356.objecter _session_command_op_assign 12 1 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 20 client.25356.objecter put_session s=0x7fec1c09ad80 osd=12 4 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 10 client.25356.objecter _send_command 1 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 --> v2:10.20.193.40:6812/730213184 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec3c012e50 con 0x7fec1c09b430 2026-02-24T17:30:28.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 20 client.25356.objecter dump_active .. 0 homeless 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fec3c097aa0 con 0x7fec4c056f10 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec4a7fc640 1 --2- 10.20.193.40:0/3459905373 >> v2:10.20.193.40:6812/730213184 conn(0x7fec1c09b430 0x7fec1c0bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec4a7fc640 1 --2- 10.20.193.40:0/3459905373 >> v2:10.20.193.40:6812/730213184 conn(0x7fec1c09b430 0x7fec1c0bb8c0 crc :-1 s=READY pgs=75 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 10 client.25356.objecter ms_handle_connect 0x7fec1c09b430 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 <== osd.12 v2:10.20.193.40:6812/730213184 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fec3c012e50 con 0x7fec1c09b430 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 10 client.25356.objecter ms_dispatch2 0x7fec4c000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 10 client.25356.objecter _finish_command 1 = system:0 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 20 client.25356.objecter put_session s=0x7fec1c09ad80 osd=12 4 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 15 client.25356.objecter _session_command_op_remove 12 1 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec23fff640 10 client.25356.objecter ms_handle_connect 0x7fec1c0740f0 2026-02-24T17:30:28.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.691+0000 7fec4affd640 1 --2- 10.20.193.40:0/3459905373 >> v2:10.20.193.120:6800/397309233 conn(0x7fec1c0740f0 0x7fec1c0945a0 secure :-1 s=READY pgs=2237 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec4001c910 tx=0x7fec400047b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 10 client.25356.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:28.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 15 client.25356.objecter _session_command_op_assign -1 2 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 20 client.25356.objecter _get_session s=0x7fec1c09ad80 osd=12 3 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 20 client.25356.objecter put_session s=0x7fec1c09ad80 osd=12 3 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 20 client.25356.objecter _get_session s=0x7fec1c09ad80 osd=12 3 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 15 client.25356.objecter _session_command_op_remove -1 2 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 20 client.25356.objecter get_session s=0x7fec1c09ad80 osd=12 3 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 15 client.25356.objecter _session_command_op_assign 12 2 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 20 client.25356.objecter put_session s=0x7fec1c09ad80 osd=12 4 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 10 client.25356.objecter _send_command 2 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 --> v2:10.20.193.40:6812/730213184 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec4c16dfa0 con 0x7fec1c09b430 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec23fff640 1 -- 10.20.193.40:0/3459905373 <== osd.12 v2:10.20.193.40:6812/730213184 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fec4c16dfa0 con 0x7fec1c09b430 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec23fff640 10 client.25356.objecter ms_dispatch2 0x7fec4c000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:28.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec23fff640 10 client.25356.objecter _finish_command 2 = system:0 2026-02-24T17:30:28.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec23fff640 20 client.25356.objecter put_session s=0x7fec1c09ad80 osd=12 4 2026-02-24T17:30:28.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec23fff640 15 client.25356.objecter _session_command_op_remove 12 2 2026-02-24T17:30:28.703 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:28.703 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:28.703 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:28.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 10 librados: watch_flush enter 2026-02-24T17:30:28.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 10 librados: watch_flush exit 2026-02-24T17:30:28.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 10 client.25356.objecter close_session for osd.12 2026-02-24T17:30:28.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 >> v2:10.20.193.40:6812/730213184 conn(0x7fec1c09b430 msgr2=0x7fec1c0bb8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 --2- 10.20.193.40:0/3459905373 >> v2:10.20.193.40:6812/730213184 conn(0x7fec1c09b430 0x7fec1c0bb8c0 crc :-1 s=READY pgs=75 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 20 client.25356.objecter put_session s=0x7fec1c09ad80 osd=12 1 2026-02-24T17:30:28.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 20 client.25356.objecter shutdown clearing up homeless session... 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 10 client.25356.objecter successfully canceled tick 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 >> v2:10.20.193.120:6800/397309233 conn(0x7fec1c0740f0 msgr2=0x7fec1c0945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 --2- 10.20.193.40:0/3459905373 >> v2:10.20.193.120:6800/397309233 conn(0x7fec1c0740f0 0x7fec1c0945a0 secure :-1 s=READY pgs=2237 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec4001c910 tx=0x7fec400047b0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec4c056f10 msgr2=0x7fec4c2085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 --2- 10.20.193.40:0/3459905373 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fec4c056f10 0x7fec4c2085a0 secure :-1 s=READY pgs=5168 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec3c003fe0 tx=0x7fec3c0066a0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec4b7fe640 1 -- 10.20.193.40:0/3459905373 reap_dead start 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 shutdown_connections 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 >> 10.20.193.40:0/3459905373 conn(0x7fec4c0b58a0 msgr2=0x7fec4c0b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 shutdown_connections 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 -- 10.20.193.40:0/3459905373 wait complete. 2026-02-24T17:30:28.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.699+0000 7fec5183b640 1 librados: shutdown 2026-02-24T17:30:28.708 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-24T17:30:28.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.767+0000 7f9ed73d5640 1 Processor -- start 2026-02-24T17:30:28.768 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.767+0000 7f9ed73d5640 1 -- start start 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f9ed00b7200 0x7f9ed0165240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed005a3f0 con 0x7f9ed00b6e30 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed00b97a0 con 0x7f9ed00b8cc0 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed00b9a80 con 0x7f9ed00b7200 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed514a640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f9ed00b6e30 0x7f9ed0059ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34470/0 (socket says 10.20.193.40:34470) 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed514a640 1 -- 10.20.193.40:0/1149949711 learned_addr learned my addr 10.20.193.40:0/1149949711 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed4949640 1 --2- 10.20.193.40:0/1149949711 >> v2:10.20.193.40:3300/0 conn(0x7f9ed00b7200 0x7f9ed0165240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ebffff640 1 -- 10.20.193.40:0/1149949711 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303272005 0 0) 0x7f9ed005a3f0 con 0x7f9ed00b6e30 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ebffff640 1 -- 10.20.193.40:0/1149949711 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9eb8003620 con 0x7f9ed00b6e30 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed4949640 1 -- 10.20.193.40:0/1149949711 >> v1:10.20.193.109:6789/0 conn(0x7f9ed00b8cc0 legacy=0x7f9ed005b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed4949640 1 -- 10.20.193.40:0/1149949711 >> v1:10.20.193.40:6789/0 conn(0x7f9ed00b6e30 legacy=0x7f9ed0059ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.769 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed4949640 1 -- 10.20.193.40:0/1149949711 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed0058c40 con 0x7f9ed00b7200 2026-02-24T17:30:28.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed4949640 1 --2- 10.20.193.40:0/1149949711 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0165240 secure :-1 s=READY pgs=5170 gs=3 cs=0 l=1 c_cookie=15009098043374692641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec4004780 tx=0x7f9ec401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04b07261a5be921 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ebffff640 1 -- 10.20.193.40:0/1149949711 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ec40a7070 con 0x7f9ed00b7200 2026-02-24T17:30:28.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ebffff640 1 -- 10.20.193.40:0/1149949711 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec40b0070 con 0x7f9ed00b7200 2026-02-24T17:30:28.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ebffff640 1 -- 10.20.193.40:0/1149949711 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ec40ab8d0 con 0x7f9ed00b7200 2026-02-24T17:30:28.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1149949711 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 msgr2=0x7f9ed0165240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.771 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 --2- 10.20.193.40:0/1149949711 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0165240 secure :-1 s=READY pgs=5170 gs=3 cs=0 l=1 c_cookie=15009098043374692641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec4004780 tx=0x7f9ec401c560 comp rx=0 tx=0).stop 2026-02-24T17:30:28.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1149949711 shutdown_connections 2026-02-24T17:30:28.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 --2- 10.20.193.40:0/1149949711 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0165240 unknown :-1 s=CLOSED pgs=5170 gs=3 cs=0 l=1 c_cookie=15009098043374692641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1149949711 >> 10.20.193.40:0/1149949711 conn(0x7f9ed00baf90 msgr2=0x7f9ed00bb390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1149949711 shutdown_connections 2026-02-24T17:30:28.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1149949711 wait complete. 2026-02-24T17:30:28.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 librados: starting msgr at 2026-02-24T17:30:28.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.771+0000 7f9ed73d5640 1 librados: starting objecter 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 Processor -- start 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 -- start start 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 librados: setting wanted keys 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 librados: calling monclient init 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9ed00b6e30 0x7f9ed016ee70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0179c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9ed00b8cc0 0x7f9ed017bd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed00597c0 con 0x7f9ed00b7200 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed00594e0 con 0x7f9ed00b8cc0 2026-02-24T17:30:28.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed00b3270 con 0x7f9ed00b6e30 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0179c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0179c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57596/0 (socket says 10.20.193.40:57596) 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 -- 10.20.193.40:0/1190050648 learned_addr learned my addr 10.20.193.40:0/1190050648 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed594b640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9ed00b8cc0 0x7f9ed017bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed514a640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9ed00b6e30 0x7f9ed016ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 -- 10.20.193.40:0/1190050648 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9ed00b6e30 msgr2=0x7f9ed016ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9ed00b6e30 0x7f9ed016ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 -- 10.20.193.40:0/1190050648 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9ed00b8cc0 msgr2=0x7f9ed017bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9ed00b8cc0 0x7f9ed017bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 -- 10.20.193.40:0/1190050648 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed0141480 con 0x7f9ed00b7200 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed4949640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0179c20 secure :-1 s=READY pgs=5171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec401a190 tx=0x7f9ec4019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 10 client.?.objecter ms_handle_connect 0x7f9ed00b7200 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 1 -- 10.20.193.40:0/1190050648 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ec40b9020 con 0x7f9ed00b7200 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 1 -- 10.20.193.40:0/1190050648 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec4003c00 con 0x7f9ed00b7200 2026-02-24T17:30:28.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 1 -- 10.20.193.40:0/1190050648 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ec40ab470 con 0x7f9ed00b7200 2026-02-24T17:30:28.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed0164710 con 0x7f9ed00b7200 2026-02-24T17:30:28.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 10 client.25365.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed01406c0 con 0x7f9ed00b7200 2026-02-24T17:30:28.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 librados: init done 2026-02-24T17:30:28.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed0165240 con 0x7f9ed00b7200 2026-02-24T17:30:28.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 1 -- 10.20.193.40:0/1190050648 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f9ec40ab630 con 0x7f9ed00b7200 2026-02-24T17:30:28.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 1 --2- 10.20.193.40:0/1190050648 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ea00740f0 0x7f9ea00945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 1 -- 10.20.193.40:0/1190050648 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f9ec4130ad0 con 0x7f9ed00b7200 2026-02-24T17:30:28.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 10 client.25365.objecter ms_dispatch2 0x7f9ed0000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:28.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 3 client.25365.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:28.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 3 client.25365.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:28.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ebdffb640 20 client.25365.objecter dump_active .. 0 homeless 2026-02-24T17:30:28.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.775+0000 7f9ed514a640 1 --2- 10.20.193.40:0/1190050648 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ea00740f0 0x7f9ea00945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.779+0000 7f9ed514a640 1 --2- 10.20.193.40:0/1190050648 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ea00740f0 0x7f9ea00945a0 secure :-1 s=READY pgs=2238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec0005980 tx=0x7f9ec0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.779+0000 7f9ebdffb640 10 client.25365.objecter ms_handle_connect 0x7f9ea00740f0 2026-02-24T17:30:28.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.779+0000 7f9ebdffb640 1 -- 10.20.193.40:0/1190050648 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f9ec40c3070 con 0x7f9ed00b7200 2026-02-24T17:30:28.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7f9ed003b110 con 0x7f9ea00740f0 2026-02-24T17:30:28.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ebdffb640 1 -- 10.20.193.40:0/1190050648 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f9ec0003500 con 0x7f9ea00740f0 2026-02-24T17:30:28.868 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 12 to deep-scrub 2026-02-24T17:30:28.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 10 librados: watch_flush enter 2026-02-24T17:30:28.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 10 librados: watch_flush exit 2026-02-24T17:30:28.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 20 client.25365.objecter shutdown clearing up homeless session... 2026-02-24T17:30:28.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 10 client.25365.objecter successfully canceled tick 2026-02-24T17:30:28.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ea00740f0 msgr2=0x7f9ea00945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 --2- 10.20.193.40:0/1190050648 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ea00740f0 0x7f9ea00945a0 secure :-1 s=READY pgs=2238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec0005980 tx=0x7f9ec0009040 comp rx=0 tx=0).stop 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 msgr2=0x7f9ed0179c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0179c20 secure :-1 s=READY pgs=5171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec401a190 tx=0x7f9ec4019300 comp rx=0 tx=0).stop 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 shutdown_connections 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 --2- 10.20.193.40:0/1190050648 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ea00740f0 0x7f9ea00945a0 unknown :-1 s=CLOSED pgs=2238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9ed00b8cc0 0x7f9ed017bd40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9ed00b7200 0x7f9ed0179c20 unknown :-1 s=CLOSED pgs=5171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 --2- 10.20.193.40:0/1190050648 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9ed00b6e30 0x7f9ed016ee70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 >> 10.20.193.40:0/1190050648 conn(0x7f9ed00baf90 msgr2=0x7f9ed00b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 shutdown_connections 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 -- 10.20.193.40:0/1190050648 wait complete. 2026-02-24T17:30:28.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.867+0000 7f9ed73d5640 1 librados: shutdown 2026-02-24T17:30:28.879 INFO:tasks.ceph:Scrubbing osd.1 2026-02-24T17:30:28.879 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:28.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.947+0000 7fc8b7fff640 1 Processor -- start 2026-02-24T17:30:28.949 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.947+0000 7fc8b7fff640 1 -- start start 2026-02-24T17:30:28.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fc8b80aff60 0x7fc8b80b0330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc8b80b3d90 0x7fc8b80b6ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b80b46d0 con 0x7fc8b80b41c0 2026-02-24T17:30:28.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b80b49b0 con 0x7fc8b80b3d90 2026-02-24T17:30:28.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b80b4c90 con 0x7fc8b80aff60 2026-02-24T17:30:28.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b67fc640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc8b80b3d90 0x7fc8b80b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.951 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b67fc640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc8b80b3d90 0x7fc8b80b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57606/0 (socket says 10.20.193.40:57606) 2026-02-24T17:30:28.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b67fc640 1 -- 10.20.193.40:0/1334812632 learned_addr learned my addr 10.20.193.40:0/1334812632 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b6ffd640 1 --2- 10.20.193.40:0/1334812632 >> v2:10.20.193.94:3300/0 conn(0x7fc8b80aff60 0x7fc8b80b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b67fc640 1 -- 10.20.193.40:0/1334812632 >> v2:10.20.193.94:3300/0 conn(0x7fc8b80aff60 msgr2=0x7fc8b80b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b67fc640 1 --2- 10.20.193.40:0/1334812632 >> v2:10.20.193.94:3300/0 conn(0x7fc8b80aff60 0x7fc8b80b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b67fc640 1 -- 10.20.193.40:0/1334812632 >> v1:10.20.193.109:6789/0 conn(0x7fc8b80b41c0 legacy=0x7fc8b8161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:28.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b67fc640 1 -- 10.20.193.40:0/1334812632 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b80b4f70 con 0x7fc8b80b3d90 2026-02-24T17:30:28.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b67fc640 1 --2- 10.20.193.40:0/1334812632 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 0x7fc8b80b6ea0 secure :-1 s=READY pgs=5172 gs=2 cs=0 l=1 c_cookie=8210025017246957287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b8165550 tx=0x7fc8a001c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71efde412e133ee7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b5ffb640 1 -- 10.20.193.40:0/1334812632 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a00a9690 con 0x7fc8b80b3d90 2026-02-24T17:30:28.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b5ffb640 1 -- 10.20.193.40:0/1334812632 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a00a9830 con 0x7fc8b80b3d90 2026-02-24T17:30:28.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b5ffb640 1 -- 10.20.193.40:0/1334812632 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a00a9c20 con 0x7fc8b80b3d90 2026-02-24T17:30:28.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 -- 10.20.193.40:0/1334812632 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 msgr2=0x7fc8b80b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 --2- 10.20.193.40:0/1334812632 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 0x7fc8b80b6ea0 secure :-1 s=READY pgs=5172 gs=2 cs=0 l=1 c_cookie=8210025017246957287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b8165550 tx=0x7fc8a001c5d0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 -- 10.20.193.40:0/1334812632 shutdown_connections 2026-02-24T17:30:28.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 --2- 10.20.193.40:0/1334812632 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 0x7fc8b80b6ea0 unknown :-1 s=CLOSED pgs=5172 gs=2 cs=0 l=1 c_cookie=8210025017246957287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 --2- 10.20.193.40:0/1334812632 >> v2:10.20.193.94:3300/0 conn(0x7fc8b80aff60 0x7fc8b80b0330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 -- 10.20.193.40:0/1334812632 >> 10.20.193.40:0/1334812632 conn(0x7fc8b80b8900 msgr2=0x7fc8b80b8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 -- 10.20.193.40:0/1334812632 shutdown_connections 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 -- 10.20.193.40:0/1334812632 wait complete. 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 librados: starting msgr at 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 librados: starting objecter 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.951+0000 7fc8b7fff640 1 Processor -- start 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 -- start start 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 librados: setting wanted keys 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 librados: calling monclient init 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8b80aff60 0x7fc8b805de10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 0x7fc8b811eb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8b80b41c0 0x7fc8b8140ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b81d1620 con 0x7fc8b80b3d90 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b816bc40 con 0x7fc8b80b41c0 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b81d17a0 con 0x7fc8b80aff60 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b67fc640 1 -- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 msgr2=0x7fc8b811eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b67fc640 1 -- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 msgr2=0x7fc8b811eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b67fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 0x7fc8b811eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b67fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 0x7fc8b811eb00 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b77fe640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8b80b41c0 0x7fc8b8140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b6ffd640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8b80aff60 0x7fc8b805de10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b6ffd640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8b80aff60 0x7fc8b805de10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:39740/0 (socket says 10.20.193.40:39740) 2026-02-24T17:30:28.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b6ffd640 1 -- 10.20.193.40:0/3399730894 learned_addr learned my addr 10.20.193.40:0/3399730894 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b77fe640 1 -- 10.20.193.40:0/3399730894 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8b80aff60 msgr2=0x7fc8b805de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b77fe640 1 --2- 10.20.193.40:0/3399730894 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc8b80aff60 0x7fc8b805de10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b77fe640 1 -- 10.20.193.40:0/3399730894 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 msgr2=0x7fc8b811eb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b77fe640 1 --2- 10.20.193.40:0/3399730894 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc8b80b3d90 0x7fc8b811eb00 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b77fe640 1 -- 10.20.193.40:0/3399730894 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b81cf400 con 0x7fc8b80b41c0 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b77fe640 1 --2- 10.20.193.40:0/3399730894 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8b80b41c0 0x7fc8b8140ea0 secure :-1 s=READY pgs=5185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a800d820 tx=0x7fc8a800dce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 10 client.?.objecter ms_handle_connect 0x7fc8b80b41c0 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a8017020 con 0x7fc8b80b41c0 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a800ba70 con 0x7fc8b80b41c0 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b811f4b0 con 0x7fc8b80b41c0 2026-02-24T17:30:28.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a8013420 con 0x7fc8b80b41c0 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 10 client.25852.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b805b370 con 0x7fc8b80b41c0 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 librados: init done 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 10 client.25852.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 15 client.25852.objecter _session_command_op_assign -1 1 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 20 client.25852.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 10 client.25852.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8b80b6e80 con 0x7fc8b80b41c0 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fc8a80135c0 con 0x7fc8b80b41c0 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 --2- 10.20.193.40:0/3399730894 >> v2:10.20.193.120:6800/397309233 conn(0x7fc888074100 0x7fc8880945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fc8a8097fa0 con 0x7fc8b80b41c0 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 10 client.25852.objecter ms_dispatch2 0x7fc8b8000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:28.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 3 client.25852.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 3 client.25852.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 10 client.25852.objecter checking command 1 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 --2- 10.20.193.40:0/3399730894 >> v2:10.20.193.94:6808/2000550170 conn(0x7fc88809b440 0x7fc8880bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 20 client.25852.objecter _get_session s=0x7fc88809ad90 osd=1 3 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 20 client.25852.objecter put_session s=0x7fc88809ad90 osd=1 3 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 15 client.25852.objecter _session_command_op_remove -1 1 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 20 client.25852.objecter _get_session s=0x7fc88809ad90 osd=1 3 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 20 client.25852.objecter get_session s=0x7fc88809ad90 osd=1 3 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 15 client.25852.objecter _session_command_op_assign 1 1 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 20 client.25852.objecter put_session s=0x7fc88809ad90 osd=1 4 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 10 client.25852.objecter _send_command 1 2026-02-24T17:30:28.963 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 --> v2:10.20.193.94:6808/2000550170 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8a800aeb0 con 0x7fc88809b440 2026-02-24T17:30:28.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 20 client.25852.objecter dump_active .. 0 homeless 2026-02-24T17:30:28.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fc8a8098390 con 0x7fc8b80b41c0 2026-02-24T17:30:28.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.955+0000 7fc8b6ffd640 1 --2- 10.20.193.40:0/3399730894 >> v2:10.20.193.120:6800/397309233 conn(0x7fc888074100 0x7fc8880945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc8b67fc640 1 --2- 10.20.193.40:0/3399730894 >> v2:10.20.193.94:6808/2000550170 conn(0x7fc88809b440 0x7fc8880bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:28.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc8b6ffd640 1 --2- 10.20.193.40:0/3399730894 >> v2:10.20.193.120:6800/397309233 conn(0x7fc888074100 0x7fc8880945b0 secure :-1 s=READY pgs=2239 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac0091e0 tx=0x7fc8ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc88ffff640 10 client.25852.objecter ms_handle_connect 0x7fc888074100 2026-02-24T17:30:28.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc88ffff640 10 client.25852.objecter ms_handle_connect 0x7fc88809b440 2026-02-24T17:30:28.964 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc8b67fc640 1 --2- 10.20.193.40:0/3399730894 >> v2:10.20.193.94:6808/2000550170 conn(0x7fc88809b440 0x7fc8880bb8d0 crc :-1 s=READY pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:28.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 <== osd.1 v2:10.20.193.94:6808/2000550170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fc8a800aeb0 con 0x7fc88809b440 2026-02-24T17:30:28.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc88ffff640 10 client.25852.objecter ms_dispatch2 0x7fc8b8000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:28.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc88ffff640 10 client.25852.objecter _finish_command 1 = system:0 2026-02-24T17:30:28.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc88ffff640 20 client.25852.objecter put_session s=0x7fc88809ad90 osd=1 4 2026-02-24T17:30:28.965 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.959+0000 7fc88ffff640 15 client.25852.objecter _session_command_op_remove 1 1 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 10 client.25852.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 15 client.25852.objecter _session_command_op_assign -1 2 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 20 client.25852.objecter _get_session s=0x7fc88809ad90 osd=1 3 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 20 client.25852.objecter put_session s=0x7fc88809ad90 osd=1 3 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 20 client.25852.objecter _get_session s=0x7fc88809ad90 osd=1 3 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 15 client.25852.objecter _session_command_op_remove -1 2 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 20 client.25852.objecter get_session s=0x7fc88809ad90 osd=1 3 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 15 client.25852.objecter _session_command_op_assign 1 2 2026-02-24T17:30:28.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 20 client.25852.objecter put_session s=0x7fc88809ad90 osd=1 4 2026-02-24T17:30:28.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 10 client.25852.objecter _send_command 2 2026-02-24T17:30:28.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 --> v2:10.20.193.94:6808/2000550170 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc8b8168e20 con 0x7fc88809b440 2026-02-24T17:30:28.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc88ffff640 1 -- 10.20.193.40:0/3399730894 <== osd.1 v2:10.20.193.94:6808/2000550170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc8b8168e20 con 0x7fc88809b440 2026-02-24T17:30:28.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc88ffff640 10 client.25852.objecter ms_dispatch2 0x7fc8b8000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:28.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc88ffff640 10 client.25852.objecter _finish_command 2 = system:0 2026-02-24T17:30:28.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc88ffff640 20 client.25852.objecter put_session s=0x7fc88809ad90 osd=1 4 2026-02-24T17:30:28.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc88ffff640 15 client.25852.objecter _session_command_op_remove 1 2 2026-02-24T17:30:28.968 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:28.969 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:28.969 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 10 librados: watch_flush enter 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 10 librados: watch_flush exit 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 10 client.25852.objecter close_session for osd.1 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 >> v2:10.20.193.94:6808/2000550170 conn(0x7fc88809b440 msgr2=0x7fc8880bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 --2- 10.20.193.40:0/3399730894 >> v2:10.20.193.94:6808/2000550170 conn(0x7fc88809b440 0x7fc8880bb8d0 crc :-1 s=READY pgs=81 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 20 client.25852.objecter put_session s=0x7fc88809ad90 osd=1 1 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 20 client.25852.objecter shutdown clearing up homeless session... 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 10 client.25852.objecter successfully canceled tick 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 >> v2:10.20.193.120:6800/397309233 conn(0x7fc888074100 msgr2=0x7fc8880945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 --2- 10.20.193.40:0/3399730894 >> v2:10.20.193.120:6800/397309233 conn(0x7fc888074100 0x7fc8880945b0 secure :-1 s=READY pgs=2239 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac0091e0 tx=0x7fc8ac008040 comp rx=0 tx=0).stop 2026-02-24T17:30:28.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8b80b41c0 msgr2=0x7fc8b8140ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:28.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 --2- 10.20.193.40:0/3399730894 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc8b80b41c0 0x7fc8b8140ea0 secure :-1 s=READY pgs=5185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a800d820 tx=0x7fc8a800dce0 comp rx=0 tx=0).stop 2026-02-24T17:30:28.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b77fe640 1 -- 10.20.193.40:0/3399730894 reap_dead start 2026-02-24T17:30:28.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 shutdown_connections 2026-02-24T17:30:28.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 >> 10.20.193.40:0/3399730894 conn(0x7fc8b80b8900 msgr2=0x7fc8b8160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:28.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 shutdown_connections 2026-02-24T17:30:28.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 -- 10.20.193.40:0/3399730894 wait complete. 2026-02-24T17:30:28.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:28.967+0000 7fc8b7fff640 1 librados: shutdown 2026-02-24T17:30:28.975 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-24T17:30:29.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2e00ede640 1 Processor -- start 2026-02-24T17:30:29.047 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2e00ede640 1 -- start start 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2e00ede640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2e00ede640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dfc16e870 con 0x7f2dfc16ba90 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2e00ede640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dfc16eb50 con 0x7f2dfc161c70 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2e00ede640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2dfc16e620 con 0x7f2dfc1618a0 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2dfa575640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2dfa575640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57618/0 (socket says 10.20.193.40:57618) 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2dfa575640 1 -- 10.20.193.40:0/3874262234 learned_addr learned my addr 10.20.193.40:0/3874262234 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2dfa575640 1 -- 10.20.193.40:0/3874262234 >> v1:10.20.193.109:6789/0 conn(0x7f2dfc161c70 legacy=0x7f2dfc16b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2dfa575640 1 -- 10.20.193.40:0/3874262234 >> v1:10.20.193.94:6789/0 conn(0x7f2dfc16ba90 legacy=0x7f2dfc0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.048 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.047+0000 7f2dfa575640 1 -- 10.20.193.40:0/3874262234 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc16ee30 con 0x7f2dfc1618a0 2026-02-24T17:30:29.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.051+0000 7f2dfa575640 1 -- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 msgr2=0x7f2dfc0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-24T17:30:29.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.051+0000 7f2dfa575640 1 -- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 msgr2=0x7f2dfc0b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:30:29.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.051+0000 7f2dfa575640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 secure :-1 s=COMPRESSION_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dfc16e7a0 tx=0x7f2df001c560 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:30:29.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.051+0000 7f2dfa575640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:30:29.256 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2dfa575640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2dfa575640 0 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2dfa575640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 msgr2=0x7f2dfc0b3890 unknown :-1 s=STATE_CLOSED l=0).mark_down 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.40:3300/0 conn(0x7f2dfc1618a0 0x7f2dfc0b3890 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.94:3300/0 conn(0x7f2de8003630 0x7f2de8023a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.109:3300/0 conn(0x7f2de8046360 0x7f2de8066810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de80670e0 con 0x7f2de80243a0 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f2de80682e0 con 0x7f2de8003630 2026-02-24T17:30:29.257 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f2de8068490 con 0x7f2de8046360 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2dfa575640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.94:3300/0 conn(0x7f2de8003630 0x7f2de8023a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2dfad76640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.109:3300/0 conn(0x7f2de8046360 0x7f2de8066810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071672966 0 0) 0x7f2de80670e0 con 0x7f2de80243a0 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 --> v1:10.20.193.40:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f2de80672b0 con 0x7f2de80243a0 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 609530176 0 0) 0x7f2de80672b0 con 0x7f2de80243a0 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 >> v2:10.20.193.109:3300/0 conn(0x7f2de8046360 msgr2=0x7f2de8066810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.109:3300/0 conn(0x7f2de8046360 0x7f2de8066810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 >> v2:10.20.193.94:3300/0 conn(0x7f2de8003630 msgr2=0x7f2de8023a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 --2- 10.20.193.40:0/3874262234 >> v2:10.20.193.94:3300/0 conn(0x7f2de8003630 0x7f2de8023a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de8068700 con 0x7f2de80243a0 2026-02-24T17:30:29.258 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f2de4002fa0 con 0x7f2de80243a0 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2dfad76640 1 -- 10.20.193.40:0/3874262234 reap_dead start 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 >> v1:10.20.193.40:6789/0 conn(0x7f2de80243a0 legacy=0x7f2de8044850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de80679b0 0x7f2de8067d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de8046730 0x7f2de8068990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de8068ed0 0x7f2de80892b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2de80682e0 con 0x7f2de8046730 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8068490 con 0x7f2de8068ed0 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8023dc0 con 0x7f2de80679b0 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9d74640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de8046730 0x7f2de8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.259 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2dfa575640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de80679b0 0x7f2de8067d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2dfad76640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de8068ed0 0x7f2de80892b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9d74640 1 -- 10.20.193.40:0/3874262234 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de80679b0 msgr2=0x7f2de8067d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9d74640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de80679b0 0x7f2de8067d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9d74640 1 -- 10.20.193.40:0/3874262234 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de8068ed0 msgr2=0x7f2de80892b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9d74640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de8068ed0 0x7f2de80892b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9d74640 1 -- 10.20.193.40:0/3874262234 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de80672b0 con 0x7f2de8046730 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9d74640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de8046730 0x7f2de8068990 secure :-1 s=READY pgs=5174 gs=9 cs=0 l=1 c_cookie=6564003520507086476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2de400c160 tx=0x7f2de80674c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b18066ca03d068c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2de4017070 con 0x7f2de8046730 2026-02-24T17:30:29.260 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de40050d0 con 0x7f2de8046730 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2df9573640 1 -- 10.20.193.40:0/3874262234 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2de4007cd0 con 0x7f2de8046730 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 -- 10.20.193.40:0/3874262234 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de8046730 msgr2=0x7f2de8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de8046730 0x7f2de8068990 secure :-1 s=READY pgs=5174 gs=9 cs=0 l=1 c_cookie=6564003520507086476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2de400c160 tx=0x7f2de80674c0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 -- 10.20.193.40:0/3874262234 shutdown_connections 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de8068ed0 0x7f2de80892b0 unknown :-1 s=CLOSED pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de8046730 0x7f2de8068990 unknown :-1 s=CLOSED pgs=5174 gs=9 cs=0 l=1 c_cookie=6564003520507086476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 --2- 10.20.193.40:0/3874262234 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de80679b0 0x7f2de8067d80 unknown :-1 s=CLOSED pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 -- 10.20.193.40:0/3874262234 >> 10.20.193.40:0/3874262234 conn(0x7f2dfc0b8fd0 msgr2=0x7f2dfc0b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 -- 10.20.193.40:0/3874262234 shutdown_connections 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 -- 10.20.193.40:0/3874262234 wait complete. 2026-02-24T17:30:29.261 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 librados: starting msgr at 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 librados: starting objecter 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 Processor -- start 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 -- start start 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 librados: setting wanted keys 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.251+0000 7f2e00ede640 1 librados: calling monclient init 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de80243a0 0x7f2dfc140340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de8046730 0x7f2dfc130bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de80679b0 0x7f2dfc131100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc0b3c20 con 0x7f2de80243a0 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc0b3aa0 con 0x7f2de80679b0 2026-02-24T17:30:29.262 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc0b4700 con 0x7f2de8046730 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de80243a0 0x7f2dfc140340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de80243a0 0x7f2dfc140340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57650/0 (socket says 10.20.193.40:57650) 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 -- 10.20.193.40:0/2792548995 learned_addr learned my addr 10.20.193.40:0/2792548995 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2df9d74640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de8046730 0x7f2dfc130bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfad76640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de80679b0 0x7f2dfc131100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 -- 10.20.193.40:0/2792548995 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de8046730 msgr2=0x7f2dfc130bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de8046730 0x7f2dfc130bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 -- 10.20.193.40:0/2792548995 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de80679b0 msgr2=0x7f2dfc131100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de80679b0 0x7f2dfc131100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.263 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 -- 10.20.193.40:0/2792548995 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc140da0 con 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2dfa575640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de80243a0 0x7f2dfc140340 secure :-1 s=READY pgs=5175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df001cad0 tx=0x7f2df0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 10 client.?.objecter ms_handle_connect 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 1 -- 10.20.193.40:0/2792548995 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2df00ba070 con 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 1 -- 10.20.193.40:0/2792548995 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df00a9ce0 con 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dfc141080 con 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 1 -- 10.20.193.40:0/2792548995 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2df0004250 con 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 10 client.25374.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dfc141920 con 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 librados: init done 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dfc0b9cf0 con 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 1 -- 10.20.193.40:0/2792548995 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f2df00c7060 con 0x7f2de80243a0 2026-02-24T17:30:29.264 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 1 --2- 10.20.193.40:0/2792548995 >> v2:10.20.193.120:6800/397309233 conn(0x7f2dc8074100 0x7f2dc80945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 1 -- 10.20.193.40:0/2792548995 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f2df0130820 con 0x7f2de80243a0 2026-02-24T17:30:29.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 10 client.25374.objecter ms_dispatch2 0x7f2dfc000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:29.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 3 client.25374.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:29.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 3 client.25374.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:29.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2df9d74640 1 --2- 10.20.193.40:0/2792548995 >> v2:10.20.193.120:6800/397309233 conn(0x7f2dc8074100 0x7f2dc80945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 20 client.25374.objecter dump_active .. 0 homeless 2026-02-24T17:30:29.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2df9d74640 1 --2- 10.20.193.40:0/2792548995 >> v2:10.20.193.120:6800/397309233 conn(0x7f2dc8074100 0x7f2dc80945b0 secure :-1 s=READY pgs=2240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2de4002990 tx=0x7f2de400a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.265 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.255+0000 7f2de2ffd640 10 client.25374.objecter ms_handle_connect 0x7f2dc8074100 2026-02-24T17:30:29.266 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.259+0000 7f2de2ffd640 1 -- 10.20.193.40:0/2792548995 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f2df00b0040 con 0x7f2de80243a0 2026-02-24T17:30:29.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2dfc03b110 con 0x7f2dc8074100 2026-02-24T17:30:29.342 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2de2ffd640 1 -- 10.20.193.40:0/2792548995 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2de4007c70 con 0x7f2dc8074100 2026-02-24T17:30:29.342 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 1 to deep-scrub 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 10 librados: watch_flush enter 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 10 librados: watch_flush exit 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 20 client.25374.objecter shutdown clearing up homeless session... 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 10 client.25374.objecter successfully canceled tick 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 >> v2:10.20.193.120:6800/397309233 conn(0x7f2dc8074100 msgr2=0x7f2dc80945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 --2- 10.20.193.40:0/2792548995 >> v2:10.20.193.120:6800/397309233 conn(0x7f2dc8074100 0x7f2dc80945b0 secure :-1 s=READY pgs=2240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2de4002990 tx=0x7f2de400a000 comp rx=0 tx=0).stop 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de80243a0 msgr2=0x7f2dfc140340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de80243a0 0x7f2dfc140340 secure :-1 s=READY pgs=5175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df001cad0 tx=0x7f2df0019300 comp rx=0 tx=0).stop 2026-02-24T17:30:29.344 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 shutdown_connections 2026-02-24T17:30:29.345 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 --2- 10.20.193.40:0/2792548995 >> v2:10.20.193.120:6800/397309233 conn(0x7f2dc8074100 0x7f2dc80945b0 unknown :-1 s=CLOSED pgs=2240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.345 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2de80679b0 0x7f2dfc131100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.345 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2de8046730 0x7f2dfc130bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.345 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 --2- 10.20.193.40:0/2792548995 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2de80243a0 0x7f2dfc140340 unknown :-1 s=CLOSED pgs=5175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.345 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 >> 10.20.193.40:0/2792548995 conn(0x7f2dfc0b8fd0 msgr2=0x7f2dfc15f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.345 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 shutdown_connections 2026-02-24T17:30:29.345 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 -- 10.20.193.40:0/2792548995 wait complete. 2026-02-24T17:30:29.345 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.343+0000 7f2e00ede640 1 librados: shutdown 2026-02-24T17:30:29.353 INFO:tasks.ceph:Scrubbing osd.5 2026-02-24T17:30:29.353 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:29.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c87f0d640 1 Processor -- start 2026-02-24T17:30:29.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c87f0d640 1 -- start start 2026-02-24T17:30:29.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c87f0d640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f1c80159e50 0x7f1c800b4a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c87f0d640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c800b33a0 con 0x7f1c801672f0 2026-02-24T17:30:29.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c87f0d640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c800b3680 con 0x7f1c8015a220 2026-02-24T17:30:29.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c87f0d640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f1c800b4570 con 0x7f1c80159e50 2026-02-24T17:30:29.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c85c82640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f1c80159e50 0x7f1c800b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c85481640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7f1c8015a220 0x7f1c80166be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.40:38356/0 (socket says 10.20.193.40:38356) 2026-02-24T17:30:29.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c85c82640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f1c80159e50 0x7f1c800b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:39786/0 (socket says 10.20.193.40:39786) 2026-02-24T17:30:29.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c85481640 1 -- 10.20.193.40:0/2894690445 learned_addr learned my addr 10.20.193.40:0/2894690445 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:29.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c85c82640 1 -- 10.20.193.40:0/2894690445 >> v1:10.20.193.109:6789/0 conn(0x7f1c8015a220 legacy=0x7f1c80166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c85c82640 1 -- 10.20.193.40:0/2894690445 >> v1:10.20.193.94:6789/0 conn(0x7f1c801672f0 legacy=0x7f1c80057430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:29.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c85c82640 1 -- 10.20.193.40:0/2894690445 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c800b3960 con 0x7f1c80159e50 2026-02-24T17:30:29.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c85c82640 1 --2- 10.20.193.40:0/2894690445 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1c80159e50 0x7f1c800b4a00 secure :-1 s=READY pgs=5479 gs=3 cs=0 l=1 c_cookie=3705071807170569137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c70004780 tx=0x7f1c7001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=336b0f2da5b763b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c84c80640 1 -- 10.20.193.40:0/2894690445 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c700aa640 con 0x7f1c80159e50 2026-02-24T17:30:29.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c84c80640 1 -- 10.20.193.40:0/2894690445 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c700af070 con 0x7f1c80159e50 2026-02-24T17:30:29.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.427+0000 7f1c84c80640 1 -- 10.20.193.40:0/2894690445 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c700aaa20 con 0x7f1c80159e50 2026-02-24T17:30:29.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- 10.20.193.40:0/2894690445 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1c80159e50 msgr2=0x7f1c800b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 --2- 10.20.193.40:0/2894690445 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1c80159e50 0x7f1c800b4a00 secure :-1 s=READY pgs=5479 gs=3 cs=0 l=1 c_cookie=3705071807170569137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c70004780 tx=0x7f1c7001c4a0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- 10.20.193.40:0/2894690445 shutdown_connections 2026-02-24T17:30:29.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 --2- 10.20.193.40:0/2894690445 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1c80159e50 0x7f1c800b4a00 unknown :-1 s=CLOSED pgs=5479 gs=3 cs=0 l=1 c_cookie=3705071807170569137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- 10.20.193.40:0/2894690445 >> 10.20.193.40:0/2894690445 conn(0x7f1c800b58a0 msgr2=0x7f1c800b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- 10.20.193.40:0/2894690445 shutdown_connections 2026-02-24T17:30:29.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- 10.20.193.40:0/2894690445 wait complete. 2026-02-24T17:30:29.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 librados: starting msgr at 2026-02-24T17:30:29.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 librados: starting objecter 2026-02-24T17:30:29.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 Processor -- start 2026-02-24T17:30:29.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- start start 2026-02-24T17:30:29.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 librados: setting wanted keys 2026-02-24T17:30:29.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 librados: calling monclient init 2026-02-24T17:30:29.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1c80159e50 0x7f1c80159480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1c8015a220 0x7f1c8017b0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1c801672f0 0x7f1c8017b620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801caf90 con 0x7f1c8015a220 2026-02-24T17:30:29.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1c800b4200 con 0x7f1c80159e50 2026-02-24T17:30:29.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801cb110 con 0x7f1c801672f0 2026-02-24T17:30:29.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1c8015a220 0x7f1c8017b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.434 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1c8015a220 0x7f1c8017b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57656/0 (socket says 10.20.193.40:57656) 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 -- 10.20.193.40:0/653407403 learned_addr learned my addr 10.20.193.40:0/653407403 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85c82640 1 --2- 10.20.193.40:0/653407403 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1c80159e50 0x7f1c80159480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c86483640 1 --2- 10.20.193.40:0/653407403 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1c801672f0 0x7f1c8017b620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 -- 10.20.193.40:0/653407403 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1c801672f0 msgr2=0x7f1c8017b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 --2- 10.20.193.40:0/653407403 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f1c801672f0 0x7f1c8017b620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 -- 10.20.193.40:0/653407403 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1c80159e50 msgr2=0x7f1c80159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 --2- 10.20.193.40:0/653407403 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f1c80159e50 0x7f1c80159480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 -- 10.20.193.40:0/653407403 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8013f980 con 0x7f1c8015a220 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c85481640 1 --2- 10.20.193.40:0/653407403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1c8015a220 0x7f1c8017b0e0 secure :-1 s=READY pgs=5176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7400c730 tx=0x7f1c7400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c6e7fc640 10 client.?.objecter ms_handle_connect 0x7f1c8015a220 2026-02-24T17:30:29.435 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c6e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c74017070 con 0x7f1c8015a220 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c74005bf0 con 0x7f1c8015a220 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8013fc60 con 0x7f1c8015a220 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c74007070 con 0x7f1c8015a220 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 10 client.25377.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c80140220 con 0x7f1c8015a220 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 librados: init done 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 10 client.25377.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 15 client.25377.objecter _session_command_op_assign -1 1 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 20 client.25377.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 10 client.25377.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c8005e880 con 0x7f1c8015a220 2026-02-24T17:30:29.436 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.431+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f1c74007210 con 0x7f1c8015a220 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 1 --2- 10.20.193.40:0/653407403 >> v2:10.20.193.120:6800/397309233 conn(0x7f1c50074080 0x7f1c50094530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f1c74096260 con 0x7f1c8015a220 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 10 client.25377.objecter ms_dispatch2 0x7f1c80000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 3 client.25377.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 3 client.25377.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 10 client.25377.objecter checking command 1 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 1 --2- 10.20.193.40:0/653407403 >> v2:10.20.193.94:6804/1872957733 conn(0x7f1c5009b3c0 0x7f1c500bb850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 20 client.25377.objecter _get_session s=0x7f1c5009ad10 osd=5 3 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 20 client.25377.objecter put_session s=0x7f1c5009ad10 osd=5 3 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 15 client.25377.objecter _session_command_op_remove -1 1 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 20 client.25377.objecter _get_session s=0x7f1c5009ad10 osd=5 3 2026-02-24T17:30:29.437 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 20 client.25377.objecter get_session s=0x7f1c5009ad10 osd=5 3 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 15 client.25377.objecter _session_command_op_assign 5 1 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 20 client.25377.objecter put_session s=0x7f1c5009ad10 osd=5 4 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 10 client.25377.objecter _send_command 1 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 --> v2:10.20.193.94:6804/1872957733 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c500bbee0 con 0x7f1c5009b3c0 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 20 client.25377.objecter dump_active .. 0 homeless 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7f1c740966c0 con 0x7f1c8015a220 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c85c82640 1 --2- 10.20.193.40:0/653407403 >> v2:10.20.193.120:6800/397309233 conn(0x7f1c50074080 0x7f1c50094530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c86483640 1 --2- 10.20.193.40:0/653407403 >> v2:10.20.193.94:6804/1872957733 conn(0x7f1c5009b3c0 0x7f1c500bb850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c85c82640 1 --2- 10.20.193.40:0/653407403 >> v2:10.20.193.120:6800/397309233 conn(0x7f1c50074080 0x7f1c50094530 secure :-1 s=READY pgs=2241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7001c4e0 tx=0x7f1c700a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 10 client.25377.objecter ms_handle_connect 0x7f1c50074080 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c86483640 1 --2- 10.20.193.40:0/653407403 >> v2:10.20.193.94:6804/1872957733 conn(0x7f1c5009b3c0 0x7f1c500bb850 crc :-1 s=READY pgs=80 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.438 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 10 client.25377.objecter ms_handle_connect 0x7f1c5009b3c0 2026-02-24T17:30:29.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 <== osd.5 v2:10.20.193.94:6804/1872957733 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f1c500bbee0 con 0x7f1c5009b3c0 2026-02-24T17:30:29.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 10 client.25377.objecter ms_dispatch2 0x7f1c80000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:29.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 10 client.25377.objecter _finish_command 1 = system:0 2026-02-24T17:30:29.439 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 20 client.25377.objecter put_session s=0x7f1c5009ad10 osd=5 4 2026-02-24T17:30:29.440 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.435+0000 7f1c6e7fc640 15 client.25377.objecter _session_command_op_remove 5 1 2026-02-24T17:30:29.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 10 client.25377.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:29.442 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 15 client.25377.objecter _session_command_op_assign -1 2 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 20 client.25377.objecter _get_session s=0x7f1c5009ad10 osd=5 3 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 20 client.25377.objecter put_session s=0x7f1c5009ad10 osd=5 3 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 20 client.25377.objecter _get_session s=0x7f1c5009ad10 osd=5 3 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 15 client.25377.objecter _session_command_op_remove -1 2 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 20 client.25377.objecter get_session s=0x7f1c5009ad10 osd=5 3 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 15 client.25377.objecter _session_command_op_assign 5 2 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 20 client.25377.objecter put_session s=0x7f1c5009ad10 osd=5 4 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 10 client.25377.objecter _send_command 2 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 --> v2:10.20.193.94:6804/1872957733 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1c800b49e0 con 0x7f1c5009b3c0 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c6e7fc640 1 -- 10.20.193.40:0/653407403 <== osd.5 v2:10.20.193.94:6804/1872957733 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1c800b49e0 con 0x7f1c5009b3c0 2026-02-24T17:30:29.443 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c6e7fc640 10 client.25377.objecter ms_dispatch2 0x7f1c80000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:29.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c6e7fc640 10 client.25377.objecter _finish_command 2 = system:0 2026-02-24T17:30:29.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c6e7fc640 20 client.25377.objecter put_session s=0x7f1c5009ad10 osd=5 4 2026-02-24T17:30:29.444 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c6e7fc640 15 client.25377.objecter _session_command_op_remove 5 2 2026-02-24T17:30:29.444 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:29.444 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:29.444 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 10 librados: watch_flush enter 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 10 librados: watch_flush exit 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 10 client.25377.objecter close_session for osd.5 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 >> v2:10.20.193.94:6804/1872957733 conn(0x7f1c5009b3c0 msgr2=0x7f1c500bb850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 --2- 10.20.193.40:0/653407403 >> v2:10.20.193.94:6804/1872957733 conn(0x7f1c5009b3c0 0x7f1c500bb850 crc :-1 s=READY pgs=80 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 20 client.25377.objecter put_session s=0x7f1c5009ad10 osd=5 1 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 20 client.25377.objecter shutdown clearing up homeless session... 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 10 client.25377.objecter successfully canceled tick 2026-02-24T17:30:29.446 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 >> v2:10.20.193.120:6800/397309233 conn(0x7f1c50074080 msgr2=0x7f1c50094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 --2- 10.20.193.40:0/653407403 >> v2:10.20.193.120:6800/397309233 conn(0x7f1c50074080 0x7f1c50094530 secure :-1 s=READY pgs=2241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7001c4e0 tx=0x7f1c700a7000 comp rx=0 tx=0).stop 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1c8015a220 msgr2=0x7f1c8017b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 --2- 10.20.193.40:0/653407403 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1c8015a220 0x7f1c8017b0e0 secure :-1 s=READY pgs=5176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7400c730 tx=0x7f1c7400cbf0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c86483640 1 -- 10.20.193.40:0/653407403 reap_dead start 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 shutdown_connections 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 >> 10.20.193.40:0/653407403 conn(0x7f1c800b58a0 msgr2=0x7f1c8005c320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 shutdown_connections 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 -- 10.20.193.40:0/653407403 wait complete. 2026-02-24T17:30:29.447 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.443+0000 7f1c87f0d640 1 librados: shutdown 2026-02-24T17:30:29.452 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-24T17:30:29.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 Processor -- start 2026-02-24T17:30:29.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- start start 2026-02-24T17:30:29.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fea781650e0 0x7fea781659a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fea7815b050 0x7fea7805b7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea780588f0 con 0x7fea7805b3d0 2026-02-24T17:30:29.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fea78058bd0 con 0x7fea781650e0 2026-02-24T17:30:29.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fea78058eb0 con 0x7fea7815b050 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea76ffd640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fea7805b3d0 0x7fea7815a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34478/0 (socket says 10.20.193.40:34478) 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea76ffd640 1 -- 10.20.193.40:0/1291096400 learned_addr learned my addr 10.20.193.40:0/1291096400 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea767fc640 1 --2- 10.20.193.40:0/1291096400 >> v2:10.20.193.40:3300/0 conn(0x7fea781650e0 0x7fea781659a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea777fe640 1 --2- 10.20.193.40:0/1291096400 >> v2:10.20.193.94:3300/0 conn(0x7fea7815b050 0x7fea7805b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea75ffb640 1 -- 10.20.193.40:0/1291096400 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129768729 0 0) 0x7fea780588f0 con 0x7fea7805b3d0 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea75ffb640 1 -- 10.20.193.40:0/1291096400 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea64003620 con 0x7fea7805b3d0 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea767fc640 1 -- 10.20.193.40:0/1291096400 >> v2:10.20.193.94:3300/0 conn(0x7fea7815b050 msgr2=0x7fea7805b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea767fc640 1 --2- 10.20.193.40:0/1291096400 >> v2:10.20.193.94:3300/0 conn(0x7fea7815b050 0x7fea7805b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea767fc640 1 -- 10.20.193.40:0/1291096400 >> v1:10.20.193.40:6789/0 conn(0x7fea7805b3d0 legacy=0x7fea7815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea767fc640 1 -- 10.20.193.40:0/1291096400 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea78059190 con 0x7fea781650e0 2026-02-24T17:30:29.517 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea767fc640 1 --2- 10.20.193.40:0/1291096400 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea781659a0 secure :-1 s=READY pgs=5178 gs=2 cs=0 l=1 c_cookie=3139772002077461502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea60004780 tx=0x7fea6001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b92b6002b8b4bfe server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea75ffb640 1 -- 10.20.193.40:0/1291096400 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea600aa690 con 0x7fea781650e0 2026-02-24T17:30:29.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea75ffb640 1 -- 10.20.193.40:0/1291096400 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea600af070 con 0x7fea781650e0 2026-02-24T17:30:29.518 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea75ffb640 1 -- 10.20.193.40:0/1291096400 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea600aaa50 con 0x7fea781650e0 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- 10.20.193.40:0/1291096400 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 msgr2=0x7fea781659a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 --2- 10.20.193.40:0/1291096400 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea781659a0 secure :-1 s=READY pgs=5178 gs=2 cs=0 l=1 c_cookie=3139772002077461502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea60004780 tx=0x7fea6001c4f0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- 10.20.193.40:0/1291096400 shutdown_connections 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 --2- 10.20.193.40:0/1291096400 >> v2:10.20.193.94:3300/0 conn(0x7fea7815b050 0x7fea7805b7a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 --2- 10.20.193.40:0/1291096400 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea781659a0 unknown :-1 s=CLOSED pgs=5178 gs=2 cs=0 l=1 c_cookie=3139772002077461502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- 10.20.193.40:0/1291096400 >> 10.20.193.40:0/1291096400 conn(0x7fea780bafd0 msgr2=0x7fea780bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- 10.20.193.40:0/1291096400 shutdown_connections 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.515+0000 7fea7d665640 1 -- 10.20.193.40:0/1291096400 wait complete. 2026-02-24T17:30:29.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 librados: starting msgr at 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 librados: starting objecter 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 Processor -- start 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 -- start start 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 librados: setting wanted keys 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 librados: calling monclient init 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea7805b3d0 0x7fea780b4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea7815b050 0x7fea7815f200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea78160e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fea780b9690 con 0x7fea781650e0 2026-02-24T17:30:29.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fea780b9510 con 0x7fea7815b050 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fea780b9810 con 0x7fea7805b3d0 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea78160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea78160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57670/0 (socket says 10.20.193.40:57670) 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 -- 10.20.193.40:0/85967072 learned_addr learned my addr 10.20.193.40:0/85967072 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea76ffd640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea7805b3d0 0x7fea780b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea767fc640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea7815b050 0x7fea7815f200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 -- 10.20.193.40:0/85967072 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea7805b3d0 msgr2=0x7fea780b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea7805b3d0 0x7fea780b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 -- 10.20.193.40:0/85967072 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea7815b050 msgr2=0x7fea7815f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea7815b050 0x7fea7815f200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 -- 10.20.193.40:0/85967072 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea78161cb0 con 0x7fea781650e0 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea777fe640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea78160e60 secure :-1 s=READY pgs=5179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea6800ffa0 tx=0x7fea6800d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 10 client.?.objecter ms_handle_connect 0x7fea781650e0 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 1 -- 10.20.193.40:0/85967072 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea68019030 con 0x7fea781650e0 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 1 -- 10.20.193.40:0/85967072 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea68015480 con 0x7fea781650e0 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea781619d0 con 0x7fea781650e0 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 1 -- 10.20.193.40:0/85967072 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea68015850 con 0x7fea781650e0 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 10 client.25386.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7817c180 con 0x7fea781650e0 2026-02-24T17:30:29.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 librados: init done 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7805b7a0 con 0x7fea781650e0 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 1 -- 10.20.193.40:0/85967072 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fea68026060 con 0x7fea781650e0 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 1 --2- 10.20.193.40:0/85967072 >> v2:10.20.193.120:6800/397309233 conn(0x7fea44074100 0x7fea440945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 1 -- 10.20.193.40:0/85967072 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fea6801a070 con 0x7fea781650e0 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 10 client.25386.objecter ms_dispatch2 0x7fea78000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 3 client.25386.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 3 client.25386.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea577fe640 20 client.25386.objecter dump_active .. 0 homeless 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.519+0000 7fea76ffd640 1 --2- 10.20.193.40:0/85967072 >> v2:10.20.193.120:6800/397309233 conn(0x7fea44074100 0x7fea440945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.523+0000 7fea76ffd640 1 --2- 10.20.193.40:0/85967072 >> v2:10.20.193.120:6800/397309233 conn(0x7fea44074100 0x7fea440945b0 secure :-1 s=READY pgs=2242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea6c007fd0 tx=0x7fea6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.523+0000 7fea577fe640 10 client.25386.objecter ms_handle_connect 0x7fea44074100 2026-02-24T17:30:29.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.523+0000 7fea577fe640 1 -- 10.20.193.40:0/85967072 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fea68011040 con 0x7fea781650e0 2026-02-24T17:30:29.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fea780bb640 con 0x7fea44074100 2026-02-24T17:30:29.609 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea577fe640 1 -- 10.20.193.40:0/85967072 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fea780bb640 con 0x7fea44074100 2026-02-24T17:30:29.609 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 5 to deep-scrub 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 10 librados: watch_flush enter 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 10 librados: watch_flush exit 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 20 client.25386.objecter shutdown clearing up homeless session... 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 10 client.25386.objecter successfully canceled tick 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 >> v2:10.20.193.120:6800/397309233 conn(0x7fea44074100 msgr2=0x7fea440945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 --2- 10.20.193.40:0/85967072 >> v2:10.20.193.120:6800/397309233 conn(0x7fea44074100 0x7fea440945b0 secure :-1 s=READY pgs=2242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea6c007fd0 tx=0x7fea6c009040 comp rx=0 tx=0).stop 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 msgr2=0x7fea78160e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea78160e60 secure :-1 s=READY pgs=5179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea6800ffa0 tx=0x7fea6800d490 comp rx=0 tx=0).stop 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 shutdown_connections 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 --2- 10.20.193.40:0/85967072 >> v2:10.20.193.120:6800/397309233 conn(0x7fea44074100 0x7fea440945b0 unknown :-1 s=CLOSED pgs=2242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fea781650e0 0x7fea78160e60 unknown :-1 s=CLOSED pgs=5179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fea7815b050 0x7fea7815f200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 --2- 10.20.193.40:0/85967072 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fea7805b3d0 0x7fea780b4bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 >> 10.20.193.40:0/85967072 conn(0x7fea780bafd0 msgr2=0x7fea780b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 shutdown_connections 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 -- 10.20.193.40:0/85967072 wait complete. 2026-02-24T17:30:29.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.611+0000 7fea7d665640 1 librados: shutdown 2026-02-24T17:30:29.620 INFO:tasks.ceph:Scrubbing osd.9 2026-02-24T17:30:29.620 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:29.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.683+0000 7f9d04ce1640 1 Processor -- start 2026-02-24T17:30:29.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- start start 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f9d000b2430 0x7f9d000b2800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f9d0005cd30 0x7f9d000b34c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0005d2f0 con 0x7f9d0015ac20 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0005e1e0 con 0x7f9d0005cd30 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0005d5d0 con 0x7f9d000b2430 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfdd74640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f9d0005cd30 0x7f9d000b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfe575640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f9d000b2430 0x7f9d000b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfdd74640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f9d0005cd30 0x7f9d000b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:36102/0 (socket says 10.20.193.40:36102) 2026-02-24T17:30:29.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfdd74640 1 -- 10.20.193.40:0/4268724468 learned_addr learned my addr 10.20.193.40:0/4268724468 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfdd74640 1 -- 10.20.193.40:0/4268724468 >> v2:10.20.193.109:3300/0 conn(0x7f9d000b2430 msgr2=0x7f9d000b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:29.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfdd74640 1 --2- 10.20.193.40:0/4268724468 >> v2:10.20.193.109:3300/0 conn(0x7f9d000b2430 0x7f9d000b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfdd74640 1 -- 10.20.193.40:0/4268724468 >> v1:10.20.193.94:6789/0 conn(0x7f9d0015ac20 legacy=0x7f9d0015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfdd74640 1 -- 10.20.193.40:0/4268724468 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0005d8b0 con 0x7f9d0005cd30 2026-02-24T17:30:29.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfdd74640 1 --2- 10.20.193.40:0/4268724468 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d0005cd30 0x7f9d000b34c0 secure :-1 s=READY pgs=5189 gs=2 cs=0 l=1 c_cookie=18421368016492858139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d000b2f00 tx=0x7f9ce801c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa5d89c43cc8b1b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.694 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfd573640 1 -- 10.20.193.40:0/4268724468 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ce80b0620 con 0x7f9d0005cd30 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfd573640 1 -- 10.20.193.40:0/4268724468 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce80b07c0 con 0x7f9d0005cd30 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9cfd573640 1 -- 10.20.193.40:0/4268724468 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ce80b0bb0 con 0x7f9d0005cd30 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- 10.20.193.40:0/4268724468 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d0005cd30 msgr2=0x7f9d000b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 --2- 10.20.193.40:0/4268724468 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d0005cd30 0x7f9d000b34c0 secure :-1 s=READY pgs=5189 gs=2 cs=0 l=1 c_cookie=18421368016492858139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d000b2f00 tx=0x7f9ce801c5d0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- 10.20.193.40:0/4268724468 shutdown_connections 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 --2- 10.20.193.40:0/4268724468 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d0005cd30 0x7f9d000b34c0 unknown :-1 s=CLOSED pgs=5189 gs=2 cs=0 l=1 c_cookie=18421368016492858139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 --2- 10.20.193.40:0/4268724468 >> v2:10.20.193.109:3300/0 conn(0x7f9d000b2430 0x7f9d000b2800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- 10.20.193.40:0/4268724468 >> 10.20.193.40:0/4268724468 conn(0x7f9d000b58a0 msgr2=0x7f9d000b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- 10.20.193.40:0/4268724468 shutdown_connections 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.687+0000 7f9d04ce1640 1 -- 10.20.193.40:0/4268724468 wait complete. 2026-02-24T17:30:29.695 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 librados: starting msgr at 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 librados: starting objecter 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 Processor -- start 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 -- start start 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 librados: setting wanted keys 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 librados: calling monclient init 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9d0005cd30 0x7f9d0011f510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d000b2430 0x7f9d00159020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9d0015ac20 0x7f9d00136fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000b3b80 con 0x7f9d0015ac20 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000b3a00 con 0x7f9d000b2430 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9d00165010 con 0x7f9d0005cd30 2026-02-24T17:30:29.696 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfed76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9d0015ac20 0x7f9d00136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d000b2430 0x7f9d00159020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d000b2430 0x7f9d00159020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.94:3300/0 says I am v2:10.20.193.40:36104/0 (socket says 10.20.193.40:36104) 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 -- 10.20.193.40:0/3636341073 learned_addr learned my addr 10.20.193.40:0/3636341073 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfed76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9d0015ac20 0x7f9d00136fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57684/0 (socket says 10.20.193.40:57684) 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfe575640 1 --2- 10.20.193.40:0/3636341073 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9d0005cd30 0x7f9d0011f510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 -- 10.20.193.40:0/3636341073 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9d0005cd30 msgr2=0x7f9d0011f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 --2- 10.20.193.40:0/3636341073 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9d0005cd30 0x7f9d0011f510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 -- 10.20.193.40:0/3636341073 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9d0015ac20 msgr2=0x7f9d00136fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 --2- 10.20.193.40:0/3636341073 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9d0015ac20 0x7f9d00136fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 -- 10.20.193.40:0/3636341073 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d00159560 con 0x7f9d000b2430 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfed76640 1 --2- 10.20.193.40:0/3636341073 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f9d0015ac20 0x7f9d00136fc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:30:29.697 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfdd74640 1 --2- 10.20.193.40:0/3636341073 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d000b2430 0x7f9d00159020 secure :-1 s=READY pgs=5190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce8004780 tx=0x7f9ce801ae10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 10 client.?.objecter ms_handle_connect 0x7f9d000b2430 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ce8004240 con 0x7f9d000b2430 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d001c8e20 con 0x7f9d000b2430 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 10 client.25873.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce80043e0 con 0x7f9d000b2430 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d00159ad0 con 0x7f9d000b2430 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 librados: init done 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ce8003930 con 0x7f9d000b2430 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 10 client.25873.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 15 client.25873.objecter _session_command_op_assign -1 1 2026-02-24T17:30:29.698 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 20 client.25873.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 10 client.25873.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d0011f2d0 con 0x7f9d000b2430 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 <== mon.1 v2:10.20.193.94:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f9ce8003ad0 con 0x7f9d000b2430 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 --2- 10.20.193.40:0/3636341073 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ccc074100 0x7f9ccc0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 <== mon.1 v2:10.20.193.94:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f9ce80bd020 con 0x7f9d000b2430 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 10 client.25873.objecter ms_dispatch2 0x7f9d00000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 3 client.25873.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 3 client.25873.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 10 client.25873.objecter checking command 1 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 --2- 10.20.193.40:0/3636341073 >> v2:10.20.193.94:6800/3536923368 conn(0x7f9ccc09b440 0x7f9ccc0bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 20 client.25873.objecter _get_session s=0x7f9ccc09ad90 osd=9 3 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 20 client.25873.objecter put_session s=0x7f9ccc09ad90 osd=9 3 2026-02-24T17:30:29.699 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 15 client.25873.objecter _session_command_op_remove -1 1 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 20 client.25873.objecter _get_session s=0x7f9ccc09ad90 osd=9 3 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 20 client.25873.objecter get_session s=0x7f9ccc09ad90 osd=9 3 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 15 client.25873.objecter _session_command_op_assign 9 1 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 20 client.25873.objecter put_session s=0x7f9ccc09ad90 osd=9 4 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 10 client.25873.objecter _send_command 1 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 --> v2:10.20.193.94:6800/3536923368 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ccc0bbf60 con 0x7f9ccc09b440 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 20 client.25873.objecter dump_active .. 0 homeless 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 <== mon.1 v2:10.20.193.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7f9ce8130ef0 con 0x7f9d000b2430 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfe575640 1 --2- 10.20.193.40:0/3636341073 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ccc074100 0x7f9ccc0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.691+0000 7f9cfed76640 1 --2- 10.20.193.40:0/3636341073 >> v2:10.20.193.94:6800/3536923368 conn(0x7f9ccc09b440 0x7f9ccc0bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.700 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9cfed76640 1 --2- 10.20.193.40:0/3636341073 >> v2:10.20.193.94:6800/3536923368 conn(0x7f9ccc09b440 0x7f9ccc0bb8d0 crc :-1 s=READY pgs=87 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9ce6ffd640 10 client.25873.objecter ms_handle_connect 0x7f9ccc09b440 2026-02-24T17:30:29.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9ce6ffd640 10 client.25873.objecter ms_handle_connect 0x7f9ccc074100 2026-02-24T17:30:29.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9cfe575640 1 --2- 10.20.193.40:0/3636341073 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ccc074100 0x7f9ccc0945b0 secure :-1 s=READY pgs=2243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d001192f0 tx=0x7f9cf4009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 <== osd.9 v2:10.20.193.94:6800/3536923368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f9ccc0bbf60 con 0x7f9ccc09b440 2026-02-24T17:30:29.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9ce6ffd640 10 client.25873.objecter ms_dispatch2 0x7f9d00000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:29.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9ce6ffd640 10 client.25873.objecter _finish_command 1 = system:0 2026-02-24T17:30:29.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9ce6ffd640 20 client.25873.objecter put_session s=0x7f9ccc09ad90 osd=9 4 2026-02-24T17:30:29.701 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.695+0000 7f9ce6ffd640 15 client.25873.objecter _session_command_op_remove 9 1 2026-02-24T17:30:29.702 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 10 client.25873.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 15 client.25873.objecter _session_command_op_assign -1 2 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 20 client.25873.objecter _get_session s=0x7f9ccc09ad90 osd=9 3 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 20 client.25873.objecter put_session s=0x7f9ccc09ad90 osd=9 3 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 20 client.25873.objecter _get_session s=0x7f9ccc09ad90 osd=9 3 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 15 client.25873.objecter _session_command_op_remove -1 2 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 20 client.25873.objecter get_session s=0x7f9ccc09ad90 osd=9 3 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 15 client.25873.objecter _session_command_op_assign 9 2 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 20 client.25873.objecter put_session s=0x7f9ccc09ad90 osd=9 4 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 10 client.25873.objecter _send_command 2 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 --> v2:10.20.193.94:6800/3536923368 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9d001653f0 con 0x7f9ccc09b440 2026-02-24T17:30:29.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9ce6ffd640 1 -- 10.20.193.40:0/3636341073 <== osd.9 v2:10.20.193.94:6800/3536923368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9d001653f0 con 0x7f9ccc09b440 2026-02-24T17:30:29.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9ce6ffd640 10 client.25873.objecter ms_dispatch2 0x7f9d00000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:29.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9ce6ffd640 10 client.25873.objecter _finish_command 2 = system:0 2026-02-24T17:30:29.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9ce6ffd640 20 client.25873.objecter put_session s=0x7f9ccc09ad90 osd=9 4 2026-02-24T17:30:29.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9ce6ffd640 15 client.25873.objecter _session_command_op_remove 9 2 2026-02-24T17:30:29.704 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:29.704 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:29.704 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:29.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 10 librados: watch_flush enter 2026-02-24T17:30:29.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 10 librados: watch_flush exit 2026-02-24T17:30:29.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 10 client.25873.objecter close_session for osd.9 2026-02-24T17:30:29.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 >> v2:10.20.193.94:6800/3536923368 conn(0x7f9ccc09b440 msgr2=0x7f9ccc0bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 --2- 10.20.193.40:0/3636341073 >> v2:10.20.193.94:6800/3536923368 conn(0x7f9ccc09b440 0x7f9ccc0bb8d0 crc :-1 s=READY pgs=87 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 20 client.25873.objecter put_session s=0x7f9ccc09ad90 osd=9 1 2026-02-24T17:30:29.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 20 client.25873.objecter shutdown clearing up homeless session... 2026-02-24T17:30:29.706 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 10 client.25873.objecter successfully canceled tick 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ccc074100 msgr2=0x7f9ccc0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 --2- 10.20.193.40:0/3636341073 >> v2:10.20.193.120:6800/397309233 conn(0x7f9ccc074100 0x7f9ccc0945b0 secure :-1 s=READY pgs=2243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d001192f0 tx=0x7f9cf4009290 comp rx=0 tx=0).stop 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d000b2430 msgr2=0x7f9d00159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 --2- 10.20.193.40:0/3636341073 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9d000b2430 0x7f9d00159020 secure :-1 s=READY pgs=5190 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce8004780 tx=0x7f9ce801ae10 comp rx=0 tx=0).stop 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9cfed76640 1 -- 10.20.193.40:0/3636341073 reap_dead start 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 shutdown_connections 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 >> 10.20.193.40:0/3636341073 conn(0x7f9d000b58a0 msgr2=0x7f9d000b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 shutdown_connections 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 -- 10.20.193.40:0/3636341073 wait complete. 2026-02-24T17:30:29.707 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.703+0000 7f9d04ce1640 1 librados: shutdown 2026-02-24T17:30:29.713 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-24T17:30:29.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc75cf6b640 1 Processor -- start 2026-02-24T17:30:29.783 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc75cf6b640 1 -- start start 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc75cf6b640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc7581607f0 0x7fc758160c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc75cf6b640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc75816aed0 con 0x7fc7580b2500 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc75cf6b640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc758166de0 con 0x7fc7580b28d0 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc75cf6b640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc758166bb0 con 0x7fc7581607f0 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc756575640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fc7580b2500 0x7fc7580b3560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34480/0 (socket says 10.20.193.40:34480) 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc756575640 1 -- 10.20.193.40:0/3545370290 learned_addr learned my addr 10.20.193.40:0/3545370290 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc756d76640 1 --2- 10.20.193.40:0/3545370290 >> v2:10.20.193.40:3300/0 conn(0x7fc7581607f0 0x7fc758160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc755573640 1 -- 10.20.193.40:0/3545370290 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238479782 0 0) 0x7fc75816aed0 con 0x7fc7580b2500 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc755573640 1 -- 10.20.193.40:0/3545370290 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc744003620 con 0x7fc7580b2500 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc756d76640 1 -- 10.20.193.40:0/3545370290 >> v1:10.20.193.94:6789/0 conn(0x7fc7580b28d0 legacy=0x7fc7580b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc756d76640 1 -- 10.20.193.40:0/3545370290 >> v1:10.20.193.40:6789/0 conn(0x7fc7580b2500 legacy=0x7fc7580b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.784 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.783+0000 7fc756d76640 1 -- 10.20.193.40:0/3545370290 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7581670c0 con 0x7fc7581607f0 2026-02-24T17:30:29.786 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 --2- 10.20.193.40:0/3545370290 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc758160c50 secure :-1 s=READY pgs=5181 gs=3 cs=0 l=1 c_cookie=8947853647229368694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc748005c90 tx=0x7fc74801d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2d297c014a3976 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc755573640 1 -- 10.20.193.40:0/3545370290 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7480b3070 con 0x7fc7581607f0 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc755573640 1 -- 10.20.193.40:0/3545370290 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7480a6750 con 0x7fc7581607f0 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc755573640 1 -- 10.20.193.40:0/3545370290 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7480a6b20 con 0x7fc7581607f0 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3545370290 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 msgr2=0x7fc758160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 --2- 10.20.193.40:0/3545370290 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc758160c50 secure :-1 s=READY pgs=5181 gs=3 cs=0 l=1 c_cookie=8947853647229368694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc748005c90 tx=0x7fc74801d860 comp rx=0 tx=0).stop 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3545370290 shutdown_connections 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 --2- 10.20.193.40:0/3545370290 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc758160c50 unknown :-1 s=CLOSED pgs=5181 gs=3 cs=0 l=1 c_cookie=8947853647229368694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3545370290 >> 10.20.193.40:0/3545370290 conn(0x7fc7580b8fd0 msgr2=0x7fc7580b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3545370290 shutdown_connections 2026-02-24T17:30:29.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3545370290 wait complete. 2026-02-24T17:30:29.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 librados: starting msgr at 2026-02-24T17:30:29.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 librados: starting objecter 2026-02-24T17:30:29.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 Processor -- start 2026-02-24T17:30:29.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- start start 2026-02-24T17:30:29.791 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 librados: setting wanted keys 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 librados: calling monclient init 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc7580b2500 0x7fc75813ee40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc7580b28d0 0x7fc75813a6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc75813abe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc758160320 con 0x7fc7581607f0 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc75816a940 con 0x7fc7580b2500 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc7580b2ca0 con 0x7fc7580b28d0 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc75813abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc75813abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57700/0 (socket says 10.20.193.40:57700) 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 -- 10.20.193.40:0/3790174960 learned_addr learned my addr 10.20.193.40:0/3790174960 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.792 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756575640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc7580b2500 0x7fc75813ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc755d74640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc7580b28d0 0x7fc75813a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 -- 10.20.193.40:0/3790174960 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc7580b28d0 msgr2=0x7fc75813a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc7580b28d0 0x7fc75813a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 -- 10.20.193.40:0/3790174960 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc7580b2500 msgr2=0x7fc75813ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc7580b2500 0x7fc75813ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 -- 10.20.193.40:0/3790174960 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75811e330 con 0x7fc7581607f0 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc756d76640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc75813abe0 secure :-1 s=READY pgs=5182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc74801b490 tx=0x7fc74801a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc73effd640 10 client.?.objecter ms_handle_connect 0x7fc7581607f0 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc73effd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc73effd640 1 -- 10.20.193.40:0/3790174960 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7480bd020 con 0x7fc7581607f0 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc73effd640 1 -- 10.20.193.40:0/3790174960 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7480ae440 con 0x7fc7581607f0 2026-02-24T17:30:29.793 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc73effd640 1 -- 10.20.193.40:0/3790174960 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7480b3040 con 0x7fc7581607f0 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75811e610 con 0x7fc7581607f0 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 10 client.25398.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75811ebd0 con 0x7fc7581607f0 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.787+0000 7fc75cf6b640 1 librados: init done 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75816aed0 con 0x7fc7581607f0 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 1 -- 10.20.193.40:0/3790174960 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fc7480b6070 con 0x7fc7581607f0 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 1 --2- 10.20.193.40:0/3790174960 >> v2:10.20.193.120:6800/397309233 conn(0x7fc724074100 0x7fc7240945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 1 -- 10.20.193.40:0/3790174960 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fc748131d30 con 0x7fc7581607f0 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 10 client.25398.objecter ms_dispatch2 0x7fc758000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 3 client.25398.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 3 client.25398.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:29.794 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 20 client.25398.objecter dump_active .. 0 homeless 2026-02-24T17:30:29.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc756575640 1 --2- 10.20.193.40:0/3790174960 >> v2:10.20.193.120:6800/397309233 conn(0x7fc724074100 0x7fc7240945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc756575640 1 --2- 10.20.193.40:0/3790174960 >> v2:10.20.193.120:6800/397309233 conn(0x7fc724074100 0x7fc7240945b0 secure :-1 s=READY pgs=2244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc74c007fd0 tx=0x7fc74c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 10 client.25398.objecter ms_handle_connect 0x7fc724074100 2026-02-24T17:30:29.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.791+0000 7fc73effd640 1 -- 10.20.193.40:0/3790174960 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fc7480c7060 con 0x7fc7581607f0 2026-02-24T17:30:29.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.879+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7fc75803b110 con 0x7fc724074100 2026-02-24T17:30:29.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.879+0000 7fc73effd640 1 -- 10.20.193.40:0/3790174960 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc74c00f780 con 0x7fc724074100 2026-02-24T17:30:29.881 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 9 to deep-scrub 2026-02-24T17:30:29.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 10 librados: watch_flush enter 2026-02-24T17:30:29.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 10 librados: watch_flush exit 2026-02-24T17:30:29.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 20 client.25398.objecter shutdown clearing up homeless session... 2026-02-24T17:30:29.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 10 client.25398.objecter successfully canceled tick 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 >> v2:10.20.193.120:6800/397309233 conn(0x7fc724074100 msgr2=0x7fc7240945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 --2- 10.20.193.40:0/3790174960 >> v2:10.20.193.120:6800/397309233 conn(0x7fc724074100 0x7fc7240945b0 secure :-1 s=READY pgs=2244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc74c007fd0 tx=0x7fc74c009040 comp rx=0 tx=0).stop 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 msgr2=0x7fc75813abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc75813abe0 secure :-1 s=READY pgs=5182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc74801b490 tx=0x7fc74801a600 comp rx=0 tx=0).stop 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 shutdown_connections 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 --2- 10.20.193.40:0/3790174960 >> v2:10.20.193.120:6800/397309233 conn(0x7fc724074100 0x7fc7240945b0 unknown :-1 s=CLOSED pgs=2244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc7581607f0 0x7fc75813abe0 unknown :-1 s=CLOSED pgs=5182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc7580b28d0 0x7fc75813a6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 --2- 10.20.193.40:0/3790174960 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc7580b2500 0x7fc75813ee40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 >> 10.20.193.40:0/3790174960 conn(0x7fc7580b8fd0 msgr2=0x7fc7581400b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 shutdown_connections 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 -- 10.20.193.40:0/3790174960 wait complete. 2026-02-24T17:30:29.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.883+0000 7fc75cf6b640 1 librados: shutdown 2026-02-24T17:30:29.893 INFO:tasks.ceph:Scrubbing osd.13 2026-02-24T17:30:29.893 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:29.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 Processor -- start 2026-02-24T17:30:29.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- start start 2026-02-24T17:30:29.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbf440b2440 0x7fbf440b2810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf440b3560 con 0x7fbf44166a10 2026-02-24T17:30:29.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf44167240 con 0x7fbf440b3fd0 2026-02-24T17:30:29.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fbf440b3b40 con 0x7fbf440b2440 2026-02-24T17:30:29.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf437fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbf440b2440 0x7fbf440b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf437fe640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbf440b2440 0x7fbf440b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57704/0 (socket says 10.20.193.40:57704) 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf42ffd640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fbf44166a10 0x7fbf440b16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34496/0 (socket says 10.20.193.40:34496) 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf437fe640 1 -- 10.20.193.40:0/3383175077 learned_addr learned my addr 10.20.193.40:0/3383175077 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf437fe640 1 -- 10.20.193.40:0/3383175077 >> v1:10.20.193.94:6789/0 conn(0x7fbf440b3fd0 legacy=0x7fbf440b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf437fe640 1 -- 10.20.193.40:0/3383175077 >> v1:10.20.193.40:6789/0 conn(0x7fbf44166a10 legacy=0x7fbf440b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf437fe640 1 -- 10.20.193.40:0/3383175077 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf44167520 con 0x7fbf440b2440 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf427fc640 1 -- 10.20.193.40:0/3383175077 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732131050 0 0) 0x7fbf440b3560 con 0x7fbf44166a10 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf437fe640 1 --2- 10.20.193.40:0/3383175077 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 0x7fbf440b2810 secure :-1 s=READY pgs=5184 gs=3 cs=0 l=1 c_cookie=7684705271039813388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf300090a0 tx=0x7fbf3001c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa58eba8be6670c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf427fc640 1 -- 10.20.193.40:0/3383175077 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf300a9630 con 0x7fbf440b2440 2026-02-24T17:30:29.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf427fc640 1 -- 10.20.193.40:0/3383175077 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf300a97d0 con 0x7fbf440b2440 2026-02-24T17:30:29.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf427fc640 1 -- 10.20.193.40:0/3383175077 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf300a9bc0 con 0x7fbf440b2440 2026-02-24T17:30:29.967 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- 10.20.193.40:0/3383175077 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 msgr2=0x7fbf440b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 --2- 10.20.193.40:0/3383175077 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 0x7fbf440b2810 secure :-1 s=READY pgs=5184 gs=3 cs=0 l=1 c_cookie=7684705271039813388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf300090a0 tx=0x7fbf3001c5f0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- 10.20.193.40:0/3383175077 shutdown_connections 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 --2- 10.20.193.40:0/3383175077 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 0x7fbf440b2810 unknown :-1 s=CLOSED pgs=5184 gs=3 cs=0 l=1 c_cookie=7684705271039813388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- 10.20.193.40:0/3383175077 >> 10.20.193.40:0/3383175077 conn(0x7fbf440b58a0 msgr2=0x7fbf440b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- 10.20.193.40:0/3383175077 shutdown_connections 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.959+0000 7fbf49d4a640 1 -- 10.20.193.40:0/3383175077 wait complete. 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 librados: starting msgr at 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 librados: starting objecter 2026-02-24T17:30:29.968 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 Processor -- start 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 -- start start 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 librados: setting wanted keys 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 librados: calling monclient init 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 0x7fbf441531e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf440b3fd0 0x7fbf441638b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf44166a10 0x7fbf44163df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4416ae70 con 0x7fbf440b2440 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4416acf0 con 0x7fbf440b3fd0 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44166e10 con 0x7fbf44166a10 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 0x7fbf441531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.969 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 0x7fbf441531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57714/0 (socket says 10.20.193.40:57714) 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 -- 10.20.193.40:0/995325018 learned_addr learned my addr 10.20.193.40:0/995325018 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf42ffd640 1 --2- 10.20.193.40:0/995325018 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf440b3fd0 0x7fbf441638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf43fff640 1 --2- 10.20.193.40:0/995325018 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf44166a10 0x7fbf44163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf43fff640 1 -- 10.20.193.40:0/995325018 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf44166a10 msgr2=0x7fbf44163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf43fff640 1 -- 10.20.193.40:0/995325018 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf44166a10 msgr2=0x7fbf44163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf43fff640 1 --2- 10.20.193.40:0/995325018 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf44166a10 0x7fbf44163df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf43fff640 1 --2- 10.20.193.40:0/995325018 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf44166a10 0x7fbf44163df0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 -- 10.20.193.40:0/995325018 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf44166a10 msgr2=0x7fbf44163df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 --2- 10.20.193.40:0/995325018 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf44166a10 0x7fbf44163df0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 -- 10.20.193.40:0/995325018 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf440b3fd0 msgr2=0x7fbf441638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.970 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 --2- 10.20.193.40:0/995325018 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf440b3fd0 0x7fbf441638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 -- 10.20.193.40:0/995325018 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf44162530 con 0x7fbf440b2440 2026-02-24T17:30:29.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf437fe640 1 --2- 10.20.193.40:0/995325018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 0x7fbf441531e0 secure :-1 s=READY pgs=5185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf3001ce90 tx=0x7fbf3001ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 10 client.?.objecter ms_handle_connect 0x7fbf440b2440 2026-02-24T17:30:29.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:29.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf30004030 con 0x7fbf440b2440 2026-02-24T17:30:29.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf300041d0 con 0x7fbf440b2440 2026-02-24T17:30:29.971 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf44162810 con 0x7fbf440b2440 2026-02-24T17:30:29.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf300045a0 con 0x7fbf440b2440 2026-02-24T17:30:29.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 10 client.25407.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf44162dd0 con 0x7fbf440b2440 2026-02-24T17:30:29.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 librados: init done 2026-02-24T17:30:29.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 10 client.25407.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:29.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 15 client.25407.objecter _session_command_op_assign -1 1 2026-02-24T17:30:29.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 20 client.25407.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 10 client.25407.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf4415d600 con 0x7fbf440b2440 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fbf300c4030 con 0x7fbf440b2440 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 --2- 10.20.193.40:0/995325018 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf14074100 0x7fbf140945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fbf301308b0 con 0x7fbf440b2440 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 10 client.25407.objecter ms_dispatch2 0x7fbf44000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 3 client.25407.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 3 client.25407.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 10 client.25407.objecter checking command 1 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 --2- 10.20.193.40:0/995325018 >> v2:10.20.193.94:6812/666336223 conn(0x7fbf1409b440 0x7fbf140bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:29.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 20 client.25407.objecter _get_session s=0x7fbf1409ad90 osd=13 3 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 20 client.25407.objecter put_session s=0x7fbf1409ad90 osd=13 3 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 15 client.25407.objecter _session_command_op_remove -1 1 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 20 client.25407.objecter _get_session s=0x7fbf1409ad90 osd=13 3 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 20 client.25407.objecter get_session s=0x7fbf1409ad90 osd=13 3 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 15 client.25407.objecter _session_command_op_assign 13 1 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 20 client.25407.objecter put_session s=0x7fbf1409ad90 osd=13 4 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 10 client.25407.objecter _send_command 1 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 --> v2:10.20.193.94:6812/666336223 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf300aeec0 con 0x7fbf1409b440 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 20 client.25407.objecter dump_active .. 0 homeless 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fbf30130ca0 con 0x7fbf440b2440 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf42ffd640 1 --2- 10.20.193.40:0/995325018 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf14074100 0x7fbf140945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.974 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.963+0000 7fbf43fff640 1 --2- 10.20.193.40:0/995325018 >> v2:10.20.193.94:6812/666336223 conn(0x7fbf1409b440 0x7fbf140bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:29.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf42ffd640 1 --2- 10.20.193.40:0/995325018 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf14074100 0x7fbf140945b0 secure :-1 s=READY pgs=2245 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf34007b60 tx=0x7fbf34007af0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf1ffff640 10 client.25407.objecter ms_handle_connect 0x7fbf14074100 2026-02-24T17:30:29.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf1ffff640 10 client.25407.objecter ms_handle_connect 0x7fbf1409b440 2026-02-24T17:30:29.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf43fff640 1 --2- 10.20.193.40:0/995325018 >> v2:10.20.193.94:6812/666336223 conn(0x7fbf1409b440 0x7fbf140bb8d0 crc :-1 s=READY pgs=70 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:29.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 <== osd.13 v2:10.20.193.94:6812/666336223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fbf300aeec0 con 0x7fbf1409b440 2026-02-24T17:30:29.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf1ffff640 10 client.25407.objecter ms_dispatch2 0x7fbf44000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:29.975 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf1ffff640 10 client.25407.objecter _finish_command 1 = system:0 2026-02-24T17:30:29.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf1ffff640 20 client.25407.objecter put_session s=0x7fbf1409ad90 osd=13 4 2026-02-24T17:30:29.976 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.967+0000 7fbf1ffff640 15 client.25407.objecter _session_command_op_remove 13 1 2026-02-24T17:30:29.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 10 client.25407.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:29.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 15 client.25407.objecter _session_command_op_assign -1 2 2026-02-24T17:30:29.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 20 client.25407.objecter _get_session s=0x7fbf1409ad90 osd=13 3 2026-02-24T17:30:29.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 20 client.25407.objecter put_session s=0x7fbf1409ad90 osd=13 3 2026-02-24T17:30:29.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 20 client.25407.objecter _get_session s=0x7fbf1409ad90 osd=13 3 2026-02-24T17:30:29.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 15 client.25407.objecter _session_command_op_remove -1 2 2026-02-24T17:30:29.977 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 20 client.25407.objecter get_session s=0x7fbf1409ad90 osd=13 3 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 15 client.25407.objecter _session_command_op_assign 13 2 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 20 client.25407.objecter put_session s=0x7fbf1409ad90 osd=13 4 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 10 client.25407.objecter _send_command 2 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 --> v2:10.20.193.94:6812/666336223 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbf44165860 con 0x7fbf1409b440 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf1ffff640 1 -- 10.20.193.40:0/995325018 <== osd.13 v2:10.20.193.94:6812/666336223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbf44165860 con 0x7fbf1409b440 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf1ffff640 10 client.25407.objecter ms_dispatch2 0x7fbf44000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf1ffff640 10 client.25407.objecter _finish_command 2 = system:0 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf1ffff640 20 client.25407.objecter put_session s=0x7fbf1409ad90 osd=13 4 2026-02-24T17:30:29.978 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf1ffff640 15 client.25407.objecter _session_command_op_remove 13 2 2026-02-24T17:30:29.979 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:29.979 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:29.979 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:29.980 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 10 librados: watch_flush enter 2026-02-24T17:30:29.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 10 librados: watch_flush exit 2026-02-24T17:30:29.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 10 client.25407.objecter close_session for osd.13 2026-02-24T17:30:29.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 >> v2:10.20.193.94:6812/666336223 conn(0x7fbf1409b440 msgr2=0x7fbf140bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 --2- 10.20.193.40:0/995325018 >> v2:10.20.193.94:6812/666336223 conn(0x7fbf1409b440 0x7fbf140bb8d0 crc :-1 s=READY pgs=70 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 20 client.25407.objecter put_session s=0x7fbf1409ad90 osd=13 1 2026-02-24T17:30:29.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 20 client.25407.objecter shutdown clearing up homeless session... 2026-02-24T17:30:29.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 10 client.25407.objecter successfully canceled tick 2026-02-24T17:30:29.981 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf14074100 msgr2=0x7fbf140945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 --2- 10.20.193.40:0/995325018 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf14074100 0x7fbf140945b0 secure :-1 s=READY pgs=2245 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf34007b60 tx=0x7fbf34007af0 comp rx=0 tx=0).stop 2026-02-24T17:30:29.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 msgr2=0x7fbf441531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:29.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 --2- 10.20.193.40:0/995325018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf440b2440 0x7fbf441531e0 secure :-1 s=READY pgs=5185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf3001ce90 tx=0x7fbf3001ae30 comp rx=0 tx=0).stop 2026-02-24T17:30:29.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf43fff640 1 -- 10.20.193.40:0/995325018 reap_dead start 2026-02-24T17:30:29.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 shutdown_connections 2026-02-24T17:30:29.982 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 >> 10.20.193.40:0/995325018 conn(0x7fbf440b58a0 msgr2=0x7fbf440b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:29.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 shutdown_connections 2026-02-24T17:30:29.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 -- 10.20.193.40:0/995325018 wait complete. 2026-02-24T17:30:29.983 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:29.975+0000 7fbf49d4a640 1 librados: shutdown 2026-02-24T17:30:29.985 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-24T17:30:30.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 Processor -- start 2026-02-24T17:30:30.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- start start 2026-02-24T17:30:30.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7faab805d1a0 0x7faab805d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7faab816ada0 0x7faab8166bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab8167130 con 0x7faab80bc470 2026-02-24T17:30:30.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7faab81673c0 con 0x7faab816ada0 2026-02-24T17:30:30.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7faab81676a0 con 0x7faab805d1a0 2026-02-24T17:30:30.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab77fe640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7faab805d1a0 0x7faab805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab77fe640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7faab805d1a0 0x7faab805d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.109:3300/0 says I am v2:10.20.193.40:39854/0 (socket says 10.20.193.40:39854) 2026-02-24T17:30:30.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab77fe640 1 -- 10.20.193.40:0/2976696725 learned_addr learned my addr 10.20.193.40:0/2976696725 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab6ffd640 1 --2- 10.20.193.40:0/2976696725 >> v2:10.20.193.94:3300/0 conn(0x7faab816ada0 0x7faab8166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab77fe640 1 -- 10.20.193.40:0/2976696725 >> v2:10.20.193.94:3300/0 conn(0x7faab816ada0 msgr2=0x7faab8166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab77fe640 1 --2- 10.20.193.40:0/2976696725 >> v2:10.20.193.94:3300/0 conn(0x7faab816ada0 0x7faab8166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab77fe640 1 -- 10.20.193.40:0/2976696725 >> v1:10.20.193.109:6789/0 conn(0x7faab80bc470 legacy=0x7faab80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.051 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab77fe640 1 -- 10.20.193.40:0/2976696725 --> v2:10.20.193.109:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab8167980 con 0x7faab805d1a0 2026-02-24T17:30:30.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab77fe640 1 --2- 10.20.193.40:0/2976696725 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 0x7faab805d570 secure :-1 s=READY pgs=5481 gs=2 cs=0 l=1 c_cookie=17712987306451574971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faab805dc70 tx=0x7faaa401c5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d12c1b980ca0bb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab67fc640 1 -- 10.20.193.40:0/2976696725 <== mon.2 v2:10.20.193.109:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faaa40b0620 con 0x7faab805d1a0 2026-02-24T17:30:30.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab67fc640 1 -- 10.20.193.40:0/2976696725 <== mon.2 v2:10.20.193.109:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa40b07c0 con 0x7faab805d1a0 2026-02-24T17:30:30.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faab67fc640 1 -- 10.20.193.40:0/2976696725 <== mon.2 v2:10.20.193.109:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faaa40b0bb0 con 0x7faab805d1a0 2026-02-24T17:30:30.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- 10.20.193.40:0/2976696725 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 msgr2=0x7faab805d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 --2- 10.20.193.40:0/2976696725 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 0x7faab805d570 secure :-1 s=READY pgs=5481 gs=2 cs=0 l=1 c_cookie=17712987306451574971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faab805dc70 tx=0x7faaa401c5d0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- 10.20.193.40:0/2976696725 shutdown_connections 2026-02-24T17:30:30.052 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 --2- 10.20.193.40:0/2976696725 >> v2:10.20.193.94:3300/0 conn(0x7faab816ada0 0x7faab8166bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 --2- 10.20.193.40:0/2976696725 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 0x7faab805d570 unknown :-1 s=CLOSED pgs=5481 gs=2 cs=0 l=1 c_cookie=17712987306451574971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- 10.20.193.40:0/2976696725 >> 10.20.193.40:0/2976696725 conn(0x7faab80bd200 msgr2=0x7faab80bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- 10.20.193.40:0/2976696725 shutdown_connections 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.051+0000 7faabdd66640 1 -- 10.20.193.40:0/2976696725 wait complete. 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 librados: starting msgr at 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 librados: starting objecter 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 Processor -- start 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 -- start start 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 librados: setting wanted keys 2026-02-24T17:30:30.053 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 librados: calling monclient init 2026-02-24T17:30:30.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 0x7faab813c8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faab80bc470 0x7faab813e1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.055 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7faab816ada0 0x7faab81652b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7faab815d9e0 con 0x7faab80bc470 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7faab815d860 con 0x7faab816ada0 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7faab81cd510 con 0x7faab805d1a0 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faab80bc470 0x7faab813e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab77fe640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 0x7faab813c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faab80bc470 0x7faab813e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57742/0 (socket says 10.20.193.40:57742) 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 -- 10.20.193.40:0/2989406142 learned_addr learned my addr 10.20.193.40:0/2989406142 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab7fff640 1 --2- 10.20.193.40:0/2989406142 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7faab816ada0 0x7faab81652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 -- 10.20.193.40:0/2989406142 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 msgr2=0x7faab813c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 --2- 10.20.193.40:0/2989406142 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 0x7faab813c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 -- 10.20.193.40:0/2989406142 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7faab816ada0 msgr2=0x7faab81652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 --2- 10.20.193.40:0/2989406142 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7faab816ada0 0x7faab81652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 -- 10.20.193.40:0/2989406142 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab813f7c0 con 0x7faab80bc470 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab6ffd640 1 --2- 10.20.193.40:0/2989406142 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faab80bc470 0x7faab813e1a0 secure :-1 s=READY pgs=5187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faaa8009430 tx=0x7faaa800ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 10 client.?.objecter ms_handle_connect 0x7faab80bc470 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 1 -- 10.20.193.40:0/2989406142 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faaa8017070 con 0x7faab80bc470 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 1 -- 10.20.193.40:0/2989406142 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa800cb60 con 0x7faab80bc470 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 1 -- 10.20.193.40:0/2989406142 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faaa8013470 con 0x7faab80bc470 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab81cb2d0 con 0x7faab80bc470 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 10 client.25410.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab813ef20 con 0x7faab80bc470 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 librados: init done 2026-02-24T17:30:30.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab8166bf0 con 0x7faab80bc470 2026-02-24T17:30:30.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 1 -- 10.20.193.40:0/2989406142 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7faaa8013610 con 0x7faab80bc470 2026-02-24T17:30:30.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 1 --2- 10.20.193.40:0/2989406142 >> v2:10.20.193.120:6800/397309233 conn(0x7faa88074100 0x7faa880945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 1 -- 10.20.193.40:0/2989406142 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7faaa800f040 con 0x7faab80bc470 2026-02-24T17:30:30.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 10 client.25410.objecter ms_dispatch2 0x7faab8000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:30.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 3 client.25410.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:30.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 3 client.25410.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:30.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faab77fe640 1 --2- 10.20.193.40:0/2989406142 >> v2:10.20.193.120:6800/397309233 conn(0x7faa88074100 0x7faa880945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.055+0000 7faa93fff640 20 client.25410.objecter dump_active .. 0 homeless 2026-02-24T17:30:30.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.059+0000 7faa93fff640 10 client.25410.objecter ms_handle_connect 0x7faa88074100 2026-02-24T17:30:30.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.059+0000 7faab77fe640 1 --2- 10.20.193.40:0/2989406142 >> v2:10.20.193.120:6800/397309233 conn(0x7faa88074100 0x7faa880945b0 secure :-1 s=READY pgs=2246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faaa4002410 tx=0x7faaa40b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.059+0000 7faa93fff640 1 -- 10.20.193.40:0/2989406142 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7faaa8060940 con 0x7faab80bc470 2026-02-24T17:30:30.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7faab8057810 con 0x7faa88074100 2026-02-24T17:30:30.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faa93fff640 1 -- 10.20.193.40:0/2989406142 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7faab8057810 con 0x7faa88074100 2026-02-24T17:30:30.142 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 13 to deep-scrub 2026-02-24T17:30:30.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 10 librados: watch_flush enter 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 10 librados: watch_flush exit 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 20 client.25410.objecter shutdown clearing up homeless session... 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 10 client.25410.objecter successfully canceled tick 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 >> v2:10.20.193.120:6800/397309233 conn(0x7faa88074100 msgr2=0x7faa880945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 --2- 10.20.193.40:0/2989406142 >> v2:10.20.193.120:6800/397309233 conn(0x7faa88074100 0x7faa880945b0 secure :-1 s=READY pgs=2246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faaa4002410 tx=0x7faaa40b3040 comp rx=0 tx=0).stop 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faab80bc470 msgr2=0x7faab813e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 --2- 10.20.193.40:0/2989406142 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faab80bc470 0x7faab813e1a0 secure :-1 s=READY pgs=5187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faaa8009430 tx=0x7faaa800ee10 comp rx=0 tx=0).stop 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 shutdown_connections 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 --2- 10.20.193.40:0/2989406142 >> v2:10.20.193.120:6800/397309233 conn(0x7faa88074100 0x7faa880945b0 unknown :-1 s=CLOSED pgs=2246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 --2- 10.20.193.40:0/2989406142 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7faab816ada0 0x7faab81652b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 --2- 10.20.193.40:0/2989406142 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7faab80bc470 0x7faab813e1a0 unknown :-1 s=CLOSED pgs=5187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 --2- 10.20.193.40:0/2989406142 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7faab805d1a0 0x7faab813c8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 >> 10.20.193.40:0/2989406142 conn(0x7faab80bd200 msgr2=0x7faab80b8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 shutdown_connections 2026-02-24T17:30:30.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 -- 10.20.193.40:0/2989406142 wait complete. 2026-02-24T17:30:30.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.143+0000 7faabdd66640 1 librados: shutdown 2026-02-24T17:30:30.153 INFO:tasks.ceph:Scrubbing osd.2 2026-02-24T17:30:30.154 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:30.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 Processor -- start 2026-02-24T17:30:30.225 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- start start 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f22ec0b2440 0x7f22ec0b2810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f22ec166a10 0x7f22ec0b16a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ec0b3560 con 0x7f22ec0b1be0 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f22ec0b3b40 con 0x7f22ec0b2440 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f22ec167240 con 0x7f22ec166a10 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22eaffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f22ec0b2440 0x7f22ec0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22eaffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f22ec0b2440 0x7f22ec0b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57752/0 (socket says 10.20.193.40:57752) 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22eaffd640 1 -- 10.20.193.40:0/3147591018 learned_addr learned my addr 10.20.193.40:0/3147591018 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22ea7fc640 1 --2- 10.20.193.40:0/3147591018 >> v2:10.20.193.94:3300/0 conn(0x7f22ec166a10 0x7f22ec0b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22eaffd640 1 -- 10.20.193.40:0/3147591018 >> v2:10.20.193.94:3300/0 conn(0x7f22ec166a10 msgr2=0x7f22ec0b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22eaffd640 1 --2- 10.20.193.40:0/3147591018 >> v2:10.20.193.94:3300/0 conn(0x7f22ec166a10 0x7f22ec0b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22eaffd640 1 -- 10.20.193.40:0/3147591018 >> v1:10.20.193.94:6789/0 conn(0x7f22ec0b1be0 legacy=0x7f22ec0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.226 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22eaffd640 1 -- 10.20.193.40:0/3147591018 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec167520 con 0x7f22ec0b2440 2026-02-24T17:30:30.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22eaffd640 1 --2- 10.20.193.40:0/3147591018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec0b2440 0x7f22ec0b2810 secure :-1 s=READY pgs=5188 gs=2 cs=0 l=1 c_cookie=14552239320965601183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22ec0b8520 tx=0x7f22e001c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f3f08fb4a0579f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22e9ffb640 1 -- 10.20.193.40:0/3147591018 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22e00a9610 con 0x7f22ec0b2440 2026-02-24T17:30:30.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22e9ffb640 1 -- 10.20.193.40:0/3147591018 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e00a97b0 con 0x7f22ec0b2440 2026-02-24T17:30:30.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22e9ffb640 1 -- 10.20.193.40:0/3147591018 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22e00a9ba0 con 0x7f22ec0b2440 2026-02-24T17:30:30.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- 10.20.193.40:0/3147591018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec0b2440 msgr2=0x7f22ec0b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 --2- 10.20.193.40:0/3147591018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec0b2440 0x7f22ec0b2810 secure :-1 s=READY pgs=5188 gs=2 cs=0 l=1 c_cookie=14552239320965601183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22ec0b8520 tx=0x7f22e001c5d0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- 10.20.193.40:0/3147591018 shutdown_connections 2026-02-24T17:30:30.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 --2- 10.20.193.40:0/3147591018 >> v2:10.20.193.94:3300/0 conn(0x7f22ec166a10 0x7f22ec0b16a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 --2- 10.20.193.40:0/3147591018 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec0b2440 0x7f22ec0b2810 unknown :-1 s=CLOSED pgs=5188 gs=2 cs=0 l=1 c_cookie=14552239320965601183 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- 10.20.193.40:0/3147591018 >> 10.20.193.40:0/3147591018 conn(0x7f22ec0b58a0 msgr2=0x7f22ec0b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- 10.20.193.40:0/3147591018 shutdown_connections 2026-02-24T17:30:30.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.227+0000 7f22f18f9640 1 -- 10.20.193.40:0/3147591018 wait complete. 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 librados: starting msgr at 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 librados: starting objecter 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 Processor -- start 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 -- start start 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 librados: setting wanted keys 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 librados: calling monclient init 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f22ec0b1be0 0x7f22ec17a2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f22ec0b2440 0x7f22ec057840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec166a10 0x7f22ec15d9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec166f90 con 0x7f22ec166a10 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec166e10 con 0x7f22ec0b2440 2026-02-24T17:30:30.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f22ec15d600 con 0x7f22ec0b1be0 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec166a10 0x7f22ec15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec166a10 0x7f22ec15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57764/0 (socket says 10.20.193.40:57764) 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 -- 10.20.193.40:0/4209073970 learned_addr learned my addr 10.20.193.40:0/4209073970 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eaffd640 1 --2- 10.20.193.40:0/4209073970 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f22ec0b1be0 0x7f22ec17a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22ea7fc640 1 --2- 10.20.193.40:0/4209073970 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f22ec0b2440 0x7f22ec057840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 -- 10.20.193.40:0/4209073970 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f22ec0b1be0 msgr2=0x7f22ec17a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 --2- 10.20.193.40:0/4209073970 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f22ec0b1be0 0x7f22ec17a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 -- 10.20.193.40:0/4209073970 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f22ec0b2440 msgr2=0x7f22ec057840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 --2- 10.20.193.40:0/4209073970 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f22ec0b2440 0x7f22ec057840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 -- 10.20.193.40:0/4209073970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ec15e3a0 con 0x7f22ec166a10 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eb7fe640 1 --2- 10.20.193.40:0/4209073970 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec166a10 0x7f22ec15d9a0 secure :-1 s=READY pgs=5189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22dc00d9a0 tx=0x7f22dc00de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 10 client.?.objecter ms_handle_connect 0x7f22ec166a10 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22dc00bad0 con 0x7f22ec166a10 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22dc018070 con 0x7f22ec166a10 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ec15e680 con 0x7f22ec166a10 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22dc013420 con 0x7f22ec166a10 2026-02-24T17:30:30.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 10 client.25416.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ec15ec40 con 0x7f22ec166a10 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 librados: init done 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 10 client.25416.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 15 client.25416.objecter _session_command_op_assign -1 1 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 20 client.25416.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 10 client.25416.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22ec0b16a0 con 0x7f22ec166a10 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f22dc0135c0 con 0x7f22ec166a10 2026-02-24T17:30:30.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 --2- 10.20.193.40:0/4209073970 >> v2:10.20.193.120:6800/397309233 conn(0x7f22bc074100 0x7f22bc0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f22dc097c50 con 0x7f22ec166a10 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 10 client.25416.objecter ms_dispatch2 0x7f22ec000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 3 client.25416.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 3 client.25416.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 10 client.25416.objecter checking command 1 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 --2- 10.20.193.40:0/4209073970 >> v2:10.20.193.109:6800/1855643564 conn(0x7f22bc09b440 0x7f22bc0bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 20 client.25416.objecter _get_session s=0x7f22bc09ad90 osd=2 3 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 20 client.25416.objecter put_session s=0x7f22bc09ad90 osd=2 3 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 15 client.25416.objecter _session_command_op_remove -1 1 2026-02-24T17:30:30.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 20 client.25416.objecter _get_session s=0x7f22bc09ad90 osd=2 3 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 20 client.25416.objecter get_session s=0x7f22bc09ad90 osd=2 3 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 15 client.25416.objecter _session_command_op_assign 2 1 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 20 client.25416.objecter put_session s=0x7f22bc09ad90 osd=2 4 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 10 client.25416.objecter _send_command 1 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 --> v2:10.20.193.109:6800/1855643564 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22dc026ec0 con 0x7f22bc09b440 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 20 client.25416.objecter dump_active .. 0 homeless 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7f22dc0980b0 con 0x7f22ec166a10 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eaffd640 1 --2- 10.20.193.40:0/4209073970 >> v2:10.20.193.120:6800/397309233 conn(0x7f22bc074100 0x7f22bc0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22ea7fc640 1 --2- 10.20.193.40:0/4209073970 >> v2:10.20.193.109:6800/1855643564 conn(0x7f22bc09b440 0x7f22bc0bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22ea7fc640 1 --2- 10.20.193.40:0/4209073970 >> v2:10.20.193.109:6800/1855643564 conn(0x7f22bc09b440 0x7f22bc0bb8d0 crc :-1 s=READY pgs=65 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 10 client.25416.objecter ms_handle_connect 0x7f22bc09b440 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22eaffd640 1 --2- 10.20.193.40:0/4209073970 >> v2:10.20.193.120:6800/397309233 conn(0x7f22bc074100 0x7f22bc0945b0 secure :-1 s=READY pgs=2247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22e001a200 tx=0x7f22e00b4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.231+0000 7f22c3fff640 10 client.25416.objecter ms_handle_connect 0x7f22bc074100 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.235+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 <== osd.2 v2:10.20.193.109:6800/1855643564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f22dc026ec0 con 0x7f22bc09b440 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.235+0000 7f22c3fff640 10 client.25416.objecter ms_dispatch2 0x7f22ec000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:30.233 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.235+0000 7f22c3fff640 10 client.25416.objecter _finish_command 1 = system:0 2026-02-24T17:30:30.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.235+0000 7f22c3fff640 20 client.25416.objecter put_session s=0x7f22bc09ad90 osd=2 4 2026-02-24T17:30:30.234 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.235+0000 7f22c3fff640 15 client.25416.objecter _session_command_op_remove 2 1 2026-02-24T17:30:30.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 10 client.25416.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:30.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 15 client.25416.objecter _session_command_op_assign -1 2 2026-02-24T17:30:30.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 20 client.25416.objecter _get_session s=0x7f22bc09ad90 osd=2 3 2026-02-24T17:30:30.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 20 client.25416.objecter put_session s=0x7f22bc09ad90 osd=2 3 2026-02-24T17:30:30.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 20 client.25416.objecter _get_session s=0x7f22bc09ad90 osd=2 3 2026-02-24T17:30:30.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 15 client.25416.objecter _session_command_op_remove -1 2 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 20 client.25416.objecter get_session s=0x7f22bc09ad90 osd=2 3 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 15 client.25416.objecter _session_command_op_assign 2 2 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 20 client.25416.objecter put_session s=0x7f22bc09ad90 osd=2 4 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 10 client.25416.objecter _send_command 2 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.239+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 --> v2:10.20.193.109:6800/1855643564 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f22ec0b4170 con 0x7f22bc09b440 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22c3fff640 1 -- 10.20.193.40:0/4209073970 <== osd.2 v2:10.20.193.109:6800/1855643564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f22ec0b4170 con 0x7f22bc09b440 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22c3fff640 10 client.25416.objecter ms_dispatch2 0x7f22ec000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22c3fff640 10 client.25416.objecter _finish_command 2 = system:0 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22c3fff640 20 client.25416.objecter put_session s=0x7f22bc09ad90 osd=2 4 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22c3fff640 15 client.25416.objecter _session_command_op_remove 2 2 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:30.241 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 10 librados: watch_flush enter 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 10 librados: watch_flush exit 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 10 client.25416.objecter close_session for osd.2 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 >> v2:10.20.193.109:6800/1855643564 conn(0x7f22bc09b440 msgr2=0x7f22bc0bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 --2- 10.20.193.40:0/4209073970 >> v2:10.20.193.109:6800/1855643564 conn(0x7f22bc09b440 0x7f22bc0bb8d0 crc :-1 s=READY pgs=65 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 20 client.25416.objecter put_session s=0x7f22bc09ad90 osd=2 1 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 20 client.25416.objecter shutdown clearing up homeless session... 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 10 client.25416.objecter successfully canceled tick 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 >> v2:10.20.193.120:6800/397309233 conn(0x7f22bc074100 msgr2=0x7f22bc0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 --2- 10.20.193.40:0/4209073970 >> v2:10.20.193.120:6800/397309233 conn(0x7f22bc074100 0x7f22bc0945b0 secure :-1 s=READY pgs=2247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22e001a200 tx=0x7f22e00b4040 comp rx=0 tx=0).stop 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec166a10 msgr2=0x7f22ec15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 --2- 10.20.193.40:0/4209073970 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f22ec166a10 0x7f22ec15d9a0 secure :-1 s=READY pgs=5189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22dc00d9a0 tx=0x7f22dc00de60 comp rx=0 tx=0).stop 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22eb7fe640 1 -- 10.20.193.40:0/4209073970 reap_dead start 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 shutdown_connections 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 >> 10.20.193.40:0/4209073970 conn(0x7f22ec0b58a0 msgr2=0x7f22ec157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 shutdown_connections 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 -- 10.20.193.40:0/4209073970 wait complete. 2026-02-24T17:30:30.242 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.243+0000 7f22f18f9640 1 librados: shutdown 2026-02-24T17:30:30.250 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-24T17:30:30.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.319+0000 7f0d50132640 1 Processor -- start 2026-02-24T17:30:30.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.319+0000 7f0d50132640 1 -- start start 2026-02-24T17:30:30.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.319+0000 7f0d50132640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f0d4805d570 0x7f0d480b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.319+0000 7f0d50132640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d481673c0 con 0x7f0d4816ada0 2026-02-24T17:30:30.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.319+0000 7f0d50132640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d481676a0 con 0x7f0d4805d1a0 2026-02-24T17:30:30.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.319+0000 7f0d50132640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f0d48167980 con 0x7f0d4805d570 2026-02-24T17:30:30.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.319+0000 7f0d4d6a6640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f0d4816ada0 0x7f0d480bc470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34506/0 (socket says 10.20.193.40:34506) 2026-02-24T17:30:30.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.319+0000 7f0d4d6a6640 1 -- 10.20.193.40:0/2989887670 learned_addr learned my addr 10.20.193.40:0/2989887670 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:30.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 --2- 10.20.193.40:0/2989887670 >> v2:10.20.193.109:3300/0 conn(0x7f0d4805d570 0x7f0d480b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093905087 0 0) 0x7f0d481673c0 con 0x7f0d4816ada0 2026-02-24T17:30:30.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d30003620 con 0x7f0d4816ada0 2026-02-24T17:30:30.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2719115102 0 0) 0x7f0d30003620 con 0x7f0d4816ada0 2026-02-24T17:30:30.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 >> v2:10.20.193.109:3300/0 conn(0x7f0d4805d570 msgr2=0x7f0d480b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 --2- 10.20.193.40:0/2989887670 >> v2:10.20.193.109:3300/0 conn(0x7f0d4805d570 0x7f0d480b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.331 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 >> v1:10.20.193.109:6789/0 conn(0x7f0d4805d1a0 legacy=0x7f0d48166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.331 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d480b4430 con 0x7f0d4816ada0 2026-02-24T17:30:30.331 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f0d3c002e80 con 0x7f0d4816ada0 2026-02-24T17:30:30.331 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 >> v1:10.20.193.40:6789/0 conn(0x7f0d4816ada0 legacy=0x7f0d480bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.331 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d30003b50 0x7f0d30003f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.331 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d300048d0 0x7f0d30004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.331 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d30005280 0x7f0d30065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.331 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48167980 con 0x7f0d30005280 2026-02-24T17:30:30.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30066190 con 0x7f0d300048d0 2026-02-24T17:30:30.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30066390 con 0x7f0d30003b50 2026-02-24T17:30:30.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d30005280 0x7f0d30065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4dea7640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d30003b50 0x7f0d30003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4d6a6640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d300048d0 0x7f0d30004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 -- 10.20.193.40:0/2989887670 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d30003b50 msgr2=0x7f0d30003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d30003b50 0x7f0d30003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.332 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 -- 10.20.193.40:0/2989887670 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d300048d0 msgr2=0x7f0d30004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d300048d0 0x7f0d30004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 -- 10.20.193.40:0/2989887670 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d30003620 con 0x7f0d30005280 2026-02-24T17:30:30.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 -- 10.20.193.40:0/2989887670 reap_dead start 2026-02-24T17:30:30.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4e6a8640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d30005280 0x7f0d30065a90 secure :-1 s=READY pgs=5191 gs=5 cs=0 l=1 c_cookie=16849896660825865633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d44005c90 tx=0x7f0d4401dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d6dbbd0a90fda1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d4400ab80 con 0x7f0d30005280 2026-02-24T17:30:30.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d440a6c20 con 0x7f0d30005280 2026-02-24T17:30:30.333 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4cea5640 1 -- 10.20.193.40:0/2989887670 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d440ae430 con 0x7f0d30005280 2026-02-24T17:30:30.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- 10.20.193.40:0/2989887670 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d30005280 msgr2=0x7f0d30065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d30005280 0x7f0d30065a90 secure :-1 s=READY pgs=5191 gs=5 cs=0 l=1 c_cookie=16849896660825865633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d44005c90 tx=0x7f0d4401dc00 comp rx=0 tx=0).stop 2026-02-24T17:30:30.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- 10.20.193.40:0/2989887670 shutdown_connections 2026-02-24T17:30:30.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 --2- 10.20.193.40:0/2989887670 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d30005280 0x7f0d30065a90 unknown :-1 s=CLOSED pgs=5191 gs=5 cs=0 l=1 c_cookie=16849896660825865633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- 10.20.193.40:0/2989887670 >> 10.20.193.40:0/2989887670 conn(0x7f0d480bd200 msgr2=0x7f0d480bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- 10.20.193.40:0/2989887670 shutdown_connections 2026-02-24T17:30:30.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- 10.20.193.40:0/2989887670 wait complete. 2026-02-24T17:30:30.334 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 librados: starting msgr at 2026-02-24T17:30:30.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 librados: starting objecter 2026-02-24T17:30:30.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 Processor -- start 2026-02-24T17:30:30.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- start start 2026-02-24T17:30:30.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 librados: setting wanted keys 2026-02-24T17:30:30.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 librados: calling monclient init 2026-02-24T17:30:30.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d30005280 0x7f0d48124cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.335 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d48169500 0x7f0d48165a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d48169970 0x7f0d48165f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0d480b49f0 con 0x7f0d48169500 2026-02-24T17:30:30.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4805d940 con 0x7f0d30005280 2026-02-24T17:30:30.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d50132640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f0d48166bf0 con 0x7f0d48169970 2026-02-24T17:30:30.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4d6a6640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d48169500 0x7f0d48165a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4d6a6640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d48169500 0x7f0d48165a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57780/0 (socket says 10.20.193.40:57780) 2026-02-24T17:30:30.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4d6a6640 1 -- 10.20.193.40:0/2517848569 learned_addr learned my addr 10.20.193.40:0/2517848569 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.336 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.323+0000 7f0d4dea7640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d30005280 0x7f0d48124cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4e6a8640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d48169970 0x7f0d48165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4d6a6640 1 -- 10.20.193.40:0/2517848569 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d48169970 msgr2=0x7f0d48165f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4d6a6640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d48169970 0x7f0d48165f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4d6a6640 1 -- 10.20.193.40:0/2517848569 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d30005280 msgr2=0x7f0d48124cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4d6a6640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d30005280 0x7f0d48124cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4d6a6640 1 -- 10.20.193.40:0/2517848569 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d48121af0 con 0x7f0d48169500 2026-02-24T17:30:30.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4d6a6640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d48169500 0x7f0d48165a00 secure :-1 s=READY pgs=5192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d3c00e7f0 tx=0x7f0d3c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 10 client.?.objecter ms_handle_connect 0x7f0d48169500 2026-02-24T17:30:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 1 -- 10.20.193.40:0/2517848569 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d3c00ca90 con 0x7f0d48169500 2026-02-24T17:30:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 1 -- 10.20.193.40:0/2517848569 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c018070 con 0x7f0d48169500 2026-02-24T17:30:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d48164c40 con 0x7f0d48169500 2026-02-24T17:30:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 1 -- 10.20.193.40:0/2517848569 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d3c013420 con 0x7f0d48169500 2026-02-24T17:30:30.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d50132640 10 client.25422.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.339 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d48165200 con 0x7f0d48169500 2026-02-24T17:30:30.339 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d50132640 1 librados: init done 2026-02-24T17:30:30.339 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d48166f80 con 0x7f0d48169500 2026-02-24T17:30:30.339 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 1 -- 10.20.193.40:0/2517848569 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f0d3c0135c0 con 0x7f0d48169500 2026-02-24T17:30:30.339 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 1 --2- 10.20.193.40:0/2517848569 >> v2:10.20.193.120:6800/397309233 conn(0x7f0d180740f0 0x7f0d180945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.339 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 1 -- 10.20.193.40:0/2517848569 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f0d3c010040 con 0x7f0d48169500 2026-02-24T17:30:30.339 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 10 client.25422.objecter ms_dispatch2 0x7f0d48000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 3 client.25422.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 3 client.25422.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 20 client.25422.objecter dump_active .. 0 homeless 2026-02-24T17:30:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4dea7640 1 --2- 10.20.193.40:0/2517848569 >> v2:10.20.193.120:6800/397309233 conn(0x7f0d180740f0 0x7f0d180945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d367fc640 10 client.25422.objecter ms_handle_connect 0x7f0d180740f0 2026-02-24T17:30:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.327+0000 7f0d4dea7640 1 --2- 10.20.193.40:0/2517848569 >> v2:10.20.193.120:6800/397309233 conn(0x7f0d180740f0 0x7f0d180945a0 secure :-1 s=READY pgs=2248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d481646e0 tx=0x7f0d38007d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.340 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.331+0000 7f0d367fc640 1 -- 10.20.193.40:0/2517848569 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f0d3c060660 con 0x7f0d48169500 2026-02-24T17:30:30.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0d48057810 con 0x7f0d180740f0 2026-02-24T17:30:30.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d367fc640 1 -- 10.20.193.40:0/2517848569 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0d48057810 con 0x7f0d180740f0 2026-02-24T17:30:30.415 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 2 to deep-scrub 2026-02-24T17:30:30.415 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 10 librados: watch_flush enter 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 10 librados: watch_flush exit 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 20 client.25422.objecter shutdown clearing up homeless session... 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 10 client.25422.objecter successfully canceled tick 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 >> v2:10.20.193.120:6800/397309233 conn(0x7f0d180740f0 msgr2=0x7f0d180945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 --2- 10.20.193.40:0/2517848569 >> v2:10.20.193.120:6800/397309233 conn(0x7f0d180740f0 0x7f0d180945a0 secure :-1 s=READY pgs=2248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d481646e0 tx=0x7f0d38007d90 comp rx=0 tx=0).stop 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d48169500 msgr2=0x7f0d48165a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d48169500 0x7f0d48165a00 secure :-1 s=READY pgs=5192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d3c00e7f0 tx=0x7f0d3c00ecb0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 shutdown_connections 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 --2- 10.20.193.40:0/2517848569 >> v2:10.20.193.120:6800/397309233 conn(0x7f0d180740f0 0x7f0d180945a0 unknown :-1 s=CLOSED pgs=2248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f0d48169970 0x7f0d48165f40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f0d48169500 0x7f0d48165a00 unknown :-1 s=CLOSED pgs=5192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 --2- 10.20.193.40:0/2517848569 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f0d30005280 0x7f0d48124cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 >> 10.20.193.40:0/2517848569 conn(0x7f0d480bd200 msgr2=0x7f0d48139d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 shutdown_connections 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 -- 10.20.193.40:0/2517848569 wait complete. 2026-02-24T17:30:30.416 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.415+0000 7f0d50132640 1 librados: shutdown 2026-02-24T17:30:30.426 INFO:tasks.ceph:Scrubbing osd.6 2026-02-24T17:30:30.426 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:30.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d8e6f640 1 Processor -- start 2026-02-24T17:30:30.510 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d8e6f640 1 -- start start 2026-02-24T17:30:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d8e6f640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f04d405cd30 0x7f04d40b2800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d8e6f640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f04d415ac20 0x7f04d415b080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d8e6f640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d40b3bd0 con 0x7f04d40b2430 2026-02-24T17:30:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d8e6f640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f04d405e1e0 con 0x7f04d405cd30 2026-02-24T17:30:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d8e6f640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f04d415b5c0 con 0x7f04d415ac20 2026-02-24T17:30:30.519 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1d74640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f04d405cd30 0x7f04d40b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1d74640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f04d405cd30 0x7f04d40b2800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57788/0 (socket says 10.20.193.40:57788) 2026-02-24T17:30:30.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1d74640 1 -- 10.20.193.40:0/3452123550 learned_addr learned my addr 10.20.193.40:0/3452123550 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1d74640 1 -- 10.20.193.40:0/3452123550 >> v2:10.20.193.94:3300/0 conn(0x7f04d415ac20 msgr2=0x7f04d415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d2d76640 1 --2- 10.20.193.40:0/3452123550 >> v2:10.20.193.94:3300/0 conn(0x7f04d415ac20 0x7f04d415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1d74640 1 --2- 10.20.193.40:0/3452123550 >> v2:10.20.193.94:3300/0 conn(0x7f04d415ac20 0x7f04d415b080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1d74640 1 -- 10.20.193.40:0/3452123550 >> v1:10.20.193.109:6789/0 conn(0x7f04d40b2430 legacy=0x7f04d40b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1d74640 1 -- 10.20.193.40:0/3452123550 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d405d2f0 con 0x7f04d405cd30 2026-02-24T17:30:30.520 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d2d76640 1 --2- 10.20.193.40:0/3452123550 >> v2:10.20.193.94:3300/0 conn(0x7f04d415ac20 0x7f04d415b080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:30:30.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1d74640 1 --2- 10.20.193.40:0/3452123550 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d405cd30 0x7f04d40b2800 secure :-1 s=READY pgs=5193 gs=2 cs=0 l=1 c_cookie=6109552848338590597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04d415ed00 tx=0x7f04bc01c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c97df21db29b85 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1573640 1 -- 10.20.193.40:0/3452123550 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04bc0a9670 con 0x7f04d405cd30 2026-02-24T17:30:30.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1573640 1 -- 10.20.193.40:0/3452123550 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc0a9810 con 0x7f04d405cd30 2026-02-24T17:30:30.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.511+0000 7f04d1573640 1 -- 10.20.193.40:0/3452123550 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04bc0a9c00 con 0x7f04d405cd30 2026-02-24T17:30:30.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3452123550 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d405cd30 msgr2=0x7f04d40b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 --2- 10.20.193.40:0/3452123550 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d405cd30 0x7f04d40b2800 secure :-1 s=READY pgs=5193 gs=2 cs=0 l=1 c_cookie=6109552848338590597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04d415ed00 tx=0x7f04bc01c5d0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3452123550 shutdown_connections 2026-02-24T17:30:30.521 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 --2- 10.20.193.40:0/3452123550 >> v2:10.20.193.94:3300/0 conn(0x7f04d415ac20 0x7f04d415b080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 --2- 10.20.193.40:0/3452123550 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d405cd30 0x7f04d40b2800 unknown :-1 s=CLOSED pgs=5193 gs=2 cs=0 l=1 c_cookie=6109552848338590597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3452123550 >> 10.20.193.40:0/3452123550 conn(0x7f04d40b58a0 msgr2=0x7f04d40b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3452123550 shutdown_connections 2026-02-24T17:30:30.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3452123550 wait complete. 2026-02-24T17:30:30.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 librados: starting msgr at 2026-02-24T17:30:30.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 librados: starting objecter 2026-02-24T17:30:30.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 Processor -- start 2026-02-24T17:30:30.522 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- start start 2026-02-24T17:30:30.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 librados: setting wanted keys 2026-02-24T17:30:30.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 librados: calling monclient init 2026-02-24T17:30:30.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f04d405cd30 0x7f04d4137320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f04d40b2430 0x7f04d4136a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d415ac20 0x7f04d411fde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04d405e670 con 0x7f04d415ac20 2026-02-24T17:30:30.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f04d405de70 con 0x7f04d405cd30 2026-02-24T17:30:30.523 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f04d4165010 con 0x7f04d40b2430 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d415ac20 0x7f04d411fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d415ac20 0x7f04d411fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57794/0 (socket says 10.20.193.40:57794) 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 -- 10.20.193.40:0/3882481814 learned_addr learned my addr 10.20.193.40:0/3882481814 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d1d74640 1 --2- 10.20.193.40:0/3882481814 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f04d40b2430 0x7f04d4136a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2575640 1 --2- 10.20.193.40:0/3882481814 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f04d405cd30 0x7f04d4137320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 -- 10.20.193.40:0/3882481814 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f04d40b2430 msgr2=0x7f04d4136a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 --2- 10.20.193.40:0/3882481814 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f04d40b2430 0x7f04d4136a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 -- 10.20.193.40:0/3882481814 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f04d405cd30 msgr2=0x7f04d4137320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 --2- 10.20.193.40:0/3882481814 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f04d405cd30 0x7f04d4137320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 -- 10.20.193.40:0/3882481814 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d4137860 con 0x7f04d415ac20 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d2d76640 1 --2- 10.20.193.40:0/3882481814 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d415ac20 0x7f04d411fde0 secure :-1 s=READY pgs=5194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04c400de90 tx=0x7f04c400b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 10 client.?.objecter ms_handle_connect 0x7f04d415ac20 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04c400be60 con 0x7f04d415ac20 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c400e860 con 0x7f04d415ac20 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04c400ec30 con 0x7f04d415ac20 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d41c8e20 con 0x7f04d415ac20 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 10 client.25428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d4137dd0 con 0x7f04d415ac20 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 librados: init done 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 10 client.25428.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 15 client.25428.objecter _session_command_op_assign -1 1 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 20 client.25428.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:30.524 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 10 client.25428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04d41653f0 con 0x7f04d415ac20 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f04c4027050 con 0x7f04d415ac20 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 --2- 10.20.193.40:0/3882481814 >> v2:10.20.193.120:6800/397309233 conn(0x7f04a0074070 0x7f04a0094520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f04c4098520 con 0x7f04d415ac20 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 10 client.25428.objecter ms_dispatch2 0x7f04d4000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 3 client.25428.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 3 client.25428.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 10 client.25428.objecter checking command 1 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 --2- 10.20.193.40:0/3882481814 >> v2:10.20.193.109:6809/2048261086 conn(0x7f04a009b410 0x7f04a00bb8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 20 client.25428.objecter _get_session s=0x7f04a009ad60 osd=6 3 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 20 client.25428.objecter put_session s=0x7f04a009ad60 osd=6 3 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 15 client.25428.objecter _session_command_op_remove -1 1 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 20 client.25428.objecter _get_session s=0x7f04a009ad60 osd=6 3 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 20 client.25428.objecter get_session s=0x7f04a009ad60 osd=6 3 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 15 client.25428.objecter _session_command_op_assign 6 1 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 20 client.25428.objecter put_session s=0x7f04a009ad60 osd=6 4 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 10 client.25428.objecter _send_command 1 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 --> v2:10.20.193.109:6809/2048261086 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04c4007e20 con 0x7f04a009b410 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 20 client.25428.objecter dump_active .. 0 homeless 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.515+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7f04c4098980 con 0x7f04d415ac20 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04d2575640 1 --2- 10.20.193.40:0/3882481814 >> v2:10.20.193.120:6800/397309233 conn(0x7f04a0074070 0x7f04a0094520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04d1d74640 1 --2- 10.20.193.40:0/3882481814 >> v2:10.20.193.109:6809/2048261086 conn(0x7f04a009b410 0x7f04a00bb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04d2575640 1 --2- 10.20.193.40:0/3882481814 >> v2:10.20.193.120:6800/397309233 conn(0x7f04a0074070 0x7f04a0094520 secure :-1 s=READY pgs=2249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04c80037b0 tx=0x7f04c80037e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04baffd640 10 client.25428.objecter ms_handle_connect 0x7f04a0074070 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04baffd640 10 client.25428.objecter ms_handle_connect 0x7f04a009b410 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04d1d74640 1 --2- 10.20.193.40:0/3882481814 >> v2:10.20.193.109:6809/2048261086 conn(0x7f04a009b410 0x7f04a00bb8a0 crc :-1 s=READY pgs=70 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 <== osd.6 v2:10.20.193.109:6809/2048261086 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f04c4007e20 con 0x7f04a009b410 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04baffd640 10 client.25428.objecter ms_dispatch2 0x7f04d4000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:30.525 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04baffd640 10 client.25428.objecter _finish_command 1 = system:0 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04baffd640 20 client.25428.objecter put_session s=0x7f04a009ad60 osd=6 4 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.519+0000 7f04baffd640 15 client.25428.objecter _session_command_op_remove 6 1 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 10 client.25428.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 15 client.25428.objecter _session_command_op_assign -1 2 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 20 client.25428.objecter _get_session s=0x7f04a009ad60 osd=6 3 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 20 client.25428.objecter put_session s=0x7f04a009ad60 osd=6 3 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 20 client.25428.objecter _get_session s=0x7f04a009ad60 osd=6 3 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 15 client.25428.objecter _session_command_op_remove -1 2 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 20 client.25428.objecter get_session s=0x7f04a009ad60 osd=6 3 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 15 client.25428.objecter _session_command_op_assign 6 2 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 20 client.25428.objecter put_session s=0x7f04a009ad60 osd=6 4 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 10 client.25428.objecter _send_command 2 2026-02-24T17:30:30.526 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 --> v2:10.20.193.109:6809/2048261086 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f04d40b8200 con 0x7f04a009b410 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04baffd640 1 -- 10.20.193.40:0/3882481814 <== osd.6 v2:10.20.193.109:6809/2048261086 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f04d40b8200 con 0x7f04a009b410 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04baffd640 10 client.25428.objecter ms_dispatch2 0x7f04d4000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04baffd640 10 client.25428.objecter _finish_command 2 = system:0 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04baffd640 20 client.25428.objecter put_session s=0x7f04a009ad60 osd=6 4 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04baffd640 15 client.25428.objecter _session_command_op_remove 6 2 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 10 librados: watch_flush enter 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 10 librados: watch_flush exit 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 10 client.25428.objecter close_session for osd.6 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 >> v2:10.20.193.109:6809/2048261086 conn(0x7f04a009b410 msgr2=0x7f04a00bb8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 --2- 10.20.193.40:0/3882481814 >> v2:10.20.193.109:6809/2048261086 conn(0x7f04a009b410 0x7f04a00bb8a0 crc :-1 s=READY pgs=70 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 20 client.25428.objecter put_session s=0x7f04a009ad60 osd=6 1 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 20 client.25428.objecter shutdown clearing up homeless session... 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 10 client.25428.objecter successfully canceled tick 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 >> v2:10.20.193.120:6800/397309233 conn(0x7f04a0074070 msgr2=0x7f04a0094520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.527 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 --2- 10.20.193.40:0/3882481814 >> v2:10.20.193.120:6800/397309233 conn(0x7f04a0074070 0x7f04a0094520 secure :-1 s=READY pgs=2249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04c80037b0 tx=0x7f04c80037e0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d415ac20 msgr2=0x7f04d411fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 --2- 10.20.193.40:0/3882481814 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f04d415ac20 0x7f04d411fde0 secure :-1 s=READY pgs=5194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04c400de90 tx=0x7f04c400b710 comp rx=0 tx=0).stop 2026-02-24T17:30:30.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d2d76640 1 -- 10.20.193.40:0/3882481814 reap_dead start 2026-02-24T17:30:30.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 shutdown_connections 2026-02-24T17:30:30.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 >> 10.20.193.40:0/3882481814 conn(0x7f04d40b58a0 msgr2=0x7f04d41393f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 shutdown_connections 2026-02-24T17:30:30.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 -- 10.20.193.40:0/3882481814 wait complete. 2026-02-24T17:30:30.528 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.527+0000 7f04d8e6f640 1 librados: shutdown 2026-02-24T17:30:30.535 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-24T17:30:30.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 Processor -- start 2026-02-24T17:30:30.605 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- start start 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f913c05d1a0 0x7f913c05d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f913c0bc470 0x7f913c0b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913c1673c0 con 0x7f913c16ada0 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f913c1676a0 con 0x7f913c05d1a0 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f913c167980 con 0x7f913c0bc470 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f913c16ada0 0x7f913c166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:34516/0 (socket says 10.20.193.40:34516) 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 -- 10.20.193.40:0/389604371 learned_addr learned my addr 10.20.193.40:0/389604371 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f913a575640 1 --2- 10.20.193.40:0/389604371 >> v2:10.20.193.94:3300/0 conn(0x7f913c05d1a0 0x7f913c05d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f913ad76640 1 --2- 10.20.193.40:0/389604371 >> v2:10.20.193.109:3300/0 conn(0x7f913c0bc470 0x7f913c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1985751322 0 0) 0x7f913c1673c0 con 0x7f913c16ada0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9128003620 con 0x7f913c16ada0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3123662880 0 0) 0x7f9128003620 con 0x7f913c16ada0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 >> v2:10.20.193.109:3300/0 conn(0x7f913c0bc470 msgr2=0x7f913c0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 --2- 10.20.193.40:0/389604371 >> v2:10.20.193.109:3300/0 conn(0x7f913c0bc470 0x7f913c0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 >> v2:10.20.193.94:3300/0 conn(0x7f913c05d1a0 msgr2=0x7f913c05d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 --2- 10.20.193.40:0/389604371 >> v2:10.20.193.94:3300/0 conn(0x7f913c05d1a0 0x7f913c05d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c0b4430 con 0x7f913c16ada0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f9124002e80 con 0x7f913c16ada0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f913a575640 1 --2- 10.20.193.40:0/389604371 >> v2:10.20.193.94:3300/0 conn(0x7f913c05d1a0 0x7f913c05d570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 >> v1:10.20.193.40:6789/0 conn(0x7f913c16ada0 legacy=0x7f913c166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9128003bf0 0x7f9128004000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91280048d0 0x7f9128004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9128005280 0x7f9128065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f913c1676a0 con 0x7f91280048d0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f913c167980 con 0x7f9128003bf0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f9128066130 con 0x7f9128005280 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91280048d0 0x7f9128004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f913a575640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9128003bf0 0x7f9128004000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f913ad76640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9128005280 0x7f9128065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.608 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 -- 10.20.193.40:0/389604371 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9128005280 msgr2=0x7f9128065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.608 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f9128005280 0x7f9128065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.608 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 -- 10.20.193.40:0/389604371 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9128003bf0 msgr2=0x7f9128004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.608 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f9128003bf0 0x7f9128004000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.608 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 -- 10.20.193.40:0/389604371 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9128003620 con 0x7f91280048d0 2026-02-24T17:30:30.608 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f913ad76640 1 -- 10.20.193.40:0/389604371 reap_dead start 2026-02-24T17:30:30.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139d74640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91280048d0 0x7f9128004d40 secure :-1 s=READY pgs=5196 gs=4 cs=0 l=1 c_cookie=7192965851978251829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91240036c0 tx=0x7f912401f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d28c5518adbe35 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9124007d40 con 0x7f91280048d0 2026-02-24T17:30:30.612 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9124005bf0 con 0x7f91280048d0 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9139573640 1 -- 10.20.193.40:0/389604371 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9124007070 con 0x7f91280048d0 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- 10.20.193.40:0/389604371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91280048d0 msgr2=0x7f9128004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91280048d0 0x7f9128004d40 secure :-1 s=READY pgs=5196 gs=4 cs=0 l=1 c_cookie=7192965851978251829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91240036c0 tx=0x7f912401f2f0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- 10.20.193.40:0/389604371 shutdown_connections 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 --2- 10.20.193.40:0/389604371 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f91280048d0 0x7f9128004d40 unknown :-1 s=CLOSED pgs=5196 gs=4 cs=0 l=1 c_cookie=7192965851978251829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- 10.20.193.40:0/389604371 >> 10.20.193.40:0/389604371 conn(0x7f913c0bd200 msgr2=0x7f913c0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- 10.20.193.40:0/389604371 shutdown_connections 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.607+0000 7f9140fec640 1 -- 10.20.193.40:0/389604371 wait complete. 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 librados: starting msgr at 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 librados: starting objecter 2026-02-24T17:30:30.613 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 Processor -- start 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 -- start start 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 librados: setting wanted keys 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 librados: calling monclient init 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f91280048d0 0x7f913c139710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f913c15c260 0x7f913c13b3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f913c13b910 0x7f913c124a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f913c05d570 con 0x7f913c13b910 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f913c0b49f0 con 0x7f91280048d0 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f913c05d6f0 con 0x7f913c15c260 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f913c13b910 0x7f913c124a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f913c13b910 0x7f913c124a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57808/0 (socket says 10.20.193.40:57808) 2026-02-24T17:30:30.614 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 -- 10.20.193.40:0/4270939120 learned_addr learned my addr 10.20.193.40:0/4270939120 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913a575640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f91280048d0 0x7f913c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9139d74640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f913c15c260 0x7f913c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 -- 10.20.193.40:0/4270939120 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f913c15c260 msgr2=0x7f913c13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f913c15c260 0x7f913c13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 -- 10.20.193.40:0/4270939120 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f91280048d0 msgr2=0x7f913c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f91280048d0 0x7f913c139710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 -- 10.20.193.40:0/4270939120 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c122390 con 0x7f913c13b910 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913ad76640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f913c13b910 0x7f913c124a00 secure :-1 s=READY pgs=5197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f913c0b9640 tx=0x7f912c008ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 10 client.?.objecter ms_handle_connect 0x7f913c13b910 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:30.615 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 1 -- 10.20.193.40:0/4270939120 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f912c016930 con 0x7f913c13b910 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 1 -- 10.20.193.40:0/4270939120 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912c01d070 con 0x7f913c13b910 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 1 -- 10.20.193.40:0/4270939120 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f912c016d70 con 0x7f913c13b910 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913c125680 con 0x7f913c13b910 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 10 client.25434.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913c1218b0 con 0x7f913c13b910 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 librados: init done 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913c0bc840 con 0x7f913c13b910 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 1 -- 10.20.193.40:0/4270939120 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f912c022460 con 0x7f913c13b910 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 1 --2- 10.20.193.40:0/4270939120 >> v2:10.20.193.120:6800/397309233 conn(0x7f9108074100 0x7f91080945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 1 -- 10.20.193.40:0/4270939120 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f912c0982a0 con 0x7f913c13b910 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 10 client.25434.objecter ms_dispatch2 0x7f913c000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:30.616 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 3 client.25434.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:30.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 3 client.25434.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:30.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913a575640 1 --2- 10.20.193.40:0/4270939120 >> v2:10.20.193.120:6800/397309233 conn(0x7f9108074100 0x7f91080945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 20 client.25434.objecter dump_active .. 0 homeless 2026-02-24T17:30:30.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f913a575640 1 --2- 10.20.193.40:0/4270939120 >> v2:10.20.193.120:6800/397309233 conn(0x7f9108074100 0x7f91080945b0 secure :-1 s=READY pgs=2250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9130004780 tx=0x7f9130009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.617 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.611+0000 7f9122ffd640 10 client.25434.objecter ms_handle_connect 0x7f9108074100 2026-02-24T17:30:30.618 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.615+0000 7f9122ffd640 1 -- 10.20.193.40:0/4270939120 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f912c027020 con 0x7f913c13b910 2026-02-24T17:30:30.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f913c057810 con 0x7f9108074100 2026-02-24T17:30:30.703 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9122ffd640 1 -- 10.20.193.40:0/4270939120 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f913c057810 con 0x7f9108074100 2026-02-24T17:30:30.703 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 6 to deep-scrub 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 10 librados: watch_flush enter 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 10 librados: watch_flush exit 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 20 client.25434.objecter shutdown clearing up homeless session... 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 10 client.25434.objecter successfully canceled tick 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 >> v2:10.20.193.120:6800/397309233 conn(0x7f9108074100 msgr2=0x7f91080945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 --2- 10.20.193.40:0/4270939120 >> v2:10.20.193.120:6800/397309233 conn(0x7f9108074100 0x7f91080945b0 secure :-1 s=READY pgs=2250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9130004780 tx=0x7f9130009290 comp rx=0 tx=0).stop 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f913c13b910 msgr2=0x7f913c124a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f913c13b910 0x7f913c124a00 secure :-1 s=READY pgs=5197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f913c0b9640 tx=0x7f912c008ea0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 shutdown_connections 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 --2- 10.20.193.40:0/4270939120 >> v2:10.20.193.120:6800/397309233 conn(0x7f9108074100 0x7f91080945b0 unknown :-1 s=CLOSED pgs=2250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f913c13b910 0x7f913c124a00 unknown :-1 s=CLOSED pgs=5197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f913c15c260 0x7f913c13b3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 --2- 10.20.193.40:0/4270939120 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f91280048d0 0x7f913c139710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 >> 10.20.193.40:0/4270939120 conn(0x7f913c0bd200 msgr2=0x7f913c13aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 shutdown_connections 2026-02-24T17:30:30.704 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 -- 10.20.193.40:0/4270939120 wait complete. 2026-02-24T17:30:30.705 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.703+0000 7f9140fec640 1 librados: shutdown 2026-02-24T17:30:30.715 INFO:tasks.ceph:Scrubbing osd.10 2026-02-24T17:30:30.716 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:30.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f8576f25640 1 Processor -- start 2026-02-24T17:30:30.787 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f8576f25640 1 -- start start 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f8576f25640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f857015d0e0 0x7f85700bb8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f8576f25640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f85700b4c10 0x7f8570056770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f8576f25640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f857016adc0 con 0x7f857015d4b0 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f8576f25640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8570167670 con 0x7f85700b4c10 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f8576f25640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f8570166a60 con 0x7f857015d0e0 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f857549b640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f85700b4c10 0x7f8570056770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f857549b640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f85700b4c10 0x7f8570056770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57812/0 (socket says 10.20.193.40:57812) 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f857549b640 1 -- 10.20.193.40:0/1056290281 learned_addr learned my addr 10.20.193.40:0/1056290281 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f8574c9a640 1 --2- 10.20.193.40:0/1056290281 >> v2:10.20.193.94:3300/0 conn(0x7f857015d0e0 0x7f85700bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.789 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f857549b640 1 -- 10.20.193.40:0/1056290281 >> v2:10.20.193.94:3300/0 conn(0x7f857015d0e0 msgr2=0x7f85700bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f857549b640 1 --2- 10.20.193.40:0/1056290281 >> v2:10.20.193.94:3300/0 conn(0x7f857015d0e0 0x7f85700bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f857549b640 1 -- 10.20.193.40:0/1056290281 >> v1:10.20.193.109:6789/0 conn(0x7f857015d4b0 legacy=0x7f85700b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.790 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.787+0000 7f857549b640 1 -- 10.20.193.40:0/1056290281 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570166d40 con 0x7f85700b4c10 2026-02-24T17:30:30.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 --2- 10.20.193.40:0/1056290281 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f85700b4c10 0x7f8570056770 secure :-1 s=READY pgs=5198 gs=2 cs=0 l=1 c_cookie=487932439780787785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85701677f0 tx=0x7f856c01d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c57bf803860649 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f85677fe640 1 -- 10.20.193.40:0/1056290281 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f856c0b3070 con 0x7f85700b4c10 2026-02-24T17:30:30.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f85677fe640 1 -- 10.20.193.40:0/1056290281 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856c0a6870 con 0x7f85700b4c10 2026-02-24T17:30:30.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f85677fe640 1 -- 10.20.193.40:0/1056290281 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f856c0a6c80 con 0x7f85700b4c10 2026-02-24T17:30:30.795 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- 10.20.193.40:0/1056290281 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f85700b4c10 msgr2=0x7f8570056770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 --2- 10.20.193.40:0/1056290281 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f85700b4c10 0x7f8570056770 secure :-1 s=READY pgs=5198 gs=2 cs=0 l=1 c_cookie=487932439780787785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85701677f0 tx=0x7f856c01d970 comp rx=0 tx=0).stop 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- 10.20.193.40:0/1056290281 shutdown_connections 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 --2- 10.20.193.40:0/1056290281 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f85700b4c10 0x7f8570056770 unknown :-1 s=CLOSED pgs=5198 gs=2 cs=0 l=1 c_cookie=487932439780787785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 --2- 10.20.193.40:0/1056290281 >> v2:10.20.193.94:3300/0 conn(0x7f857015d0e0 0x7f85700bb8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- 10.20.193.40:0/1056290281 >> 10.20.193.40:0/1056290281 conn(0x7f8570054860 msgr2=0x7f85700bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- 10.20.193.40:0/1056290281 shutdown_connections 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- 10.20.193.40:0/1056290281 wait complete. 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 librados: starting msgr at 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 librados: starting objecter 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 Processor -- start 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- start start 2026-02-24T17:30:30.796 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 librados: setting wanted keys 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 librados: calling monclient init 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f85700b4c10 0x7f8570167d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f857015d0e0 0x7f8570133990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f857015d4b0 0x7f85701695a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f857016a8d0 con 0x7f857015d4b0 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f857016a750 con 0x7f857015d0e0 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f857016aa50 con 0x7f85700b4c10 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f857015d4b0 0x7f85701695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f857015d4b0 0x7f85701695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57824/0 (socket says 10.20.193.40:57824) 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 -- 10.20.193.40:0/3329531583 learned_addr learned my addr 10.20.193.40:0/3329531583 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.797 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8574c9a640 1 --2- 10.20.193.40:0/3329531583 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f85700b4c10 0x7f8570167d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8567fff640 1 --2- 10.20.193.40:0/3329531583 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f857015d0e0 0x7f8570133990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 -- 10.20.193.40:0/3329531583 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f85700b4c10 msgr2=0x7f8570167d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 --2- 10.20.193.40:0/3329531583 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f85700b4c10 0x7f8570167d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 -- 10.20.193.40:0/3329531583 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f857015d0e0 msgr2=0x7f8570133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 --2- 10.20.193.40:0/3329531583 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f857015d0e0 0x7f8570133990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 -- 10.20.193.40:0/3329531583 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570168ec0 con 0x7f857015d4b0 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f857549b640 1 --2- 10.20.193.40:0/3329531583 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f857015d4b0 0x7f85701695a0 secure :-1 s=READY pgs=5199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f856c01d3e0 tx=0x7f856c01a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f85657fa640 10 client.?.objecter ms_handle_connect 0x7f857015d4b0 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f85657fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f856c0bd020 con 0x7f857015d4b0 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856c0ae440 con 0x7f857015d4b0 2026-02-24T17:30:30.798 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f856c0b3040 con 0x7f857015d4b0 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85701cb0c0 con 0x7f857015d4b0 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 10 client.25440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85701341a0 con 0x7f857015d4b0 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 librados: init done 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 10 client.25440.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 15 client.25440.objecter _session_command_op_assign -1 1 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 20 client.25440.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 10 client.25440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.799 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.791+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f857005ca50 con 0x7f857015d4b0 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f856c0b6070 con 0x7f857015d4b0 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 1 --2- 10.20.193.40:0/3329531583 >> v2:10.20.193.120:6800/397309233 conn(0x7f8540074080 0x7f8540094530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f856c132650 con 0x7f857015d4b0 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 10 client.25440.objecter ms_dispatch2 0x7f8570000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 3 client.25440.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 3 client.25440.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f8574c9a640 1 --2- 10.20.193.40:0/3329531583 >> v2:10.20.193.120:6800/397309233 conn(0x7f8540074080 0x7f8540094530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 10 client.25440.objecter checking command 1 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 1 --2- 10.20.193.40:0/3329531583 >> v2:10.20.193.109:6808/194638238 conn(0x7f854009b3c0 0x7f85400bb850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 20 client.25440.objecter _get_session s=0x7f854009ad10 osd=10 3 2026-02-24T17:30:30.800 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 20 client.25440.objecter put_session s=0x7f854009ad10 osd=10 3 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 15 client.25440.objecter _session_command_op_remove -1 1 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 20 client.25440.objecter _get_session s=0x7f854009ad10 osd=10 3 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 20 client.25440.objecter get_session s=0x7f854009ad10 osd=10 3 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 15 client.25440.objecter _session_command_op_assign 10 1 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 20 client.25440.objecter put_session s=0x7f854009ad10 osd=10 4 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 10 client.25440.objecter _send_command 1 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 --> v2:10.20.193.109:6808/194638238 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f856c0a9ec0 con 0x7f854009b3c0 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 20 client.25440.objecter dump_active .. 0 homeless 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7f856c132a40 con 0x7f857015d4b0 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f8567fff640 1 --2- 10.20.193.40:0/3329531583 >> v2:10.20.193.109:6808/194638238 conn(0x7f854009b3c0 0x7f85400bb850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f8574c9a640 1 --2- 10.20.193.40:0/3329531583 >> v2:10.20.193.120:6800/397309233 conn(0x7f8540074080 0x7f8540094530 secure :-1 s=READY pgs=2251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8570138d40 tx=0x7f8560008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 10 client.25440.objecter ms_handle_connect 0x7f8540074080 2026-02-24T17:30:30.801 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 10 client.25440.objecter ms_handle_connect 0x7f854009b3c0 2026-02-24T17:30:30.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f8567fff640 1 --2- 10.20.193.40:0/3329531583 >> v2:10.20.193.109:6808/194638238 conn(0x7f854009b3c0 0x7f85400bb850 crc :-1 s=READY pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 <== osd.10 v2:10.20.193.109:6808/194638238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f856c0a9ec0 con 0x7f854009b3c0 2026-02-24T17:30:30.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 10 client.25440.objecter ms_dispatch2 0x7f8570000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:30.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 10 client.25440.objecter _finish_command 1 = system:0 2026-02-24T17:30:30.802 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 20 client.25440.objecter put_session s=0x7f854009ad10 osd=10 4 2026-02-24T17:30:30.803 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.795+0000 7f85657fa640 15 client.25440.objecter _session_command_op_remove 10 1 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 10 client.25440.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 15 client.25440.objecter _session_command_op_assign -1 2 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 20 client.25440.objecter _get_session s=0x7f854009ad10 osd=10 3 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 20 client.25440.objecter put_session s=0x7f854009ad10 osd=10 3 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 20 client.25440.objecter _get_session s=0x7f854009ad10 osd=10 3 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 15 client.25440.objecter _session_command_op_remove -1 2 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 20 client.25440.objecter get_session s=0x7f854009ad10 osd=10 3 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 15 client.25440.objecter _session_command_op_assign 10 2 2026-02-24T17:30:30.804 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 20 client.25440.objecter put_session s=0x7f854009ad10 osd=10 4 2026-02-24T17:30:30.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 10 client.25440.objecter _send_command 2 2026-02-24T17:30:30.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 --> v2:10.20.193.109:6808/194638238 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8570056770 con 0x7f854009b3c0 2026-02-24T17:30:30.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f85657fa640 1 -- 10.20.193.40:0/3329531583 <== osd.10 v2:10.20.193.109:6808/194638238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8570056770 con 0x7f854009b3c0 2026-02-24T17:30:30.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f85657fa640 10 client.25440.objecter ms_dispatch2 0x7f8570000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:30.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f85657fa640 10 client.25440.objecter _finish_command 2 = system:0 2026-02-24T17:30:30.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f85657fa640 20 client.25440.objecter put_session s=0x7f854009ad10 osd=10 4 2026-02-24T17:30:30.805 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f85657fa640 15 client.25440.objecter _session_command_op_remove 10 2 2026-02-24T17:30:30.805 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:30.806 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:30.806 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:30.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 10 librados: watch_flush enter 2026-02-24T17:30:30.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 10 librados: watch_flush exit 2026-02-24T17:30:30.807 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 10 client.25440.objecter close_session for osd.10 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 >> v2:10.20.193.109:6808/194638238 conn(0x7f854009b3c0 msgr2=0x7f85400bb850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 --2- 10.20.193.40:0/3329531583 >> v2:10.20.193.109:6808/194638238 conn(0x7f854009b3c0 0x7f85400bb850 crc :-1 s=READY pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 20 client.25440.objecter put_session s=0x7f854009ad10 osd=10 1 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 20 client.25440.objecter shutdown clearing up homeless session... 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 10 client.25440.objecter successfully canceled tick 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 >> v2:10.20.193.120:6800/397309233 conn(0x7f8540074080 msgr2=0x7f8540094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 --2- 10.20.193.40:0/3329531583 >> v2:10.20.193.120:6800/397309233 conn(0x7f8540074080 0x7f8540094530 secure :-1 s=READY pgs=2251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8570138d40 tx=0x7f8560008040 comp rx=0 tx=0).stop 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f857015d4b0 msgr2=0x7f85701695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 --2- 10.20.193.40:0/3329531583 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f857015d4b0 0x7f85701695a0 secure :-1 s=READY pgs=5199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f856c01d3e0 tx=0x7f856c01a710 comp rx=0 tx=0).stop 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f857549b640 1 -- 10.20.193.40:0/3329531583 reap_dead start 2026-02-24T17:30:30.808 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 shutdown_connections 2026-02-24T17:30:30.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 >> 10.20.193.40:0/3329531583 conn(0x7f8570054860 msgr2=0x7f857015b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 shutdown_connections 2026-02-24T17:30:30.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 -- 10.20.193.40:0/3329531583 wait complete. 2026-02-24T17:30:30.809 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.803+0000 7f8576f25640 1 librados: shutdown 2026-02-24T17:30:30.813 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-24T17:30:30.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.871+0000 7fc1797c8640 1 Processor -- start 2026-02-24T17:30:30.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.871+0000 7fc1797c8640 1 -- start start 2026-02-24T17:30:30.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc17415a010 0x7fc1740565f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.874 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fc174167350 0x7fc1740b42c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc174056b30 con 0x7fc174164b40 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc174056e00 con 0x7fc17415a010 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fc1740570e0 con 0x7fc174167350 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc172ffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc17415a010 0x7fc1740565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc172ffd640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fc17415a010 0x7fc1740565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57836/0 (socket says 10.20.193.40:57836) 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc172ffd640 1 -- 10.20.193.40:0/360354458 learned_addr learned my addr 10.20.193.40:0/360354458 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1737fe640 1 --2- 10.20.193.40:0/360354458 >> v2:10.20.193.94:3300/0 conn(0x7fc174167350 0x7fc1740b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc172ffd640 1 -- 10.20.193.40:0/360354458 >> v2:10.20.193.94:3300/0 conn(0x7fc174167350 msgr2=0x7fc1740b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc172ffd640 1 --2- 10.20.193.40:0/360354458 >> v2:10.20.193.94:3300/0 conn(0x7fc174167350 0x7fc1740b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc172ffd640 1 -- 10.20.193.40:0/360354458 >> v1:10.20.193.94:6789/0 conn(0x7fc174164b40 legacy=0x7fc174166c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:30.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc172ffd640 1 -- 10.20.193.40:0/360354458 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1740573c0 con 0x7fc17415a010 2026-02-24T17:30:30.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc172ffd640 1 --2- 10.20.193.40:0/360354458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc17415a010 0x7fc1740565f0 secure :-1 s=READY pgs=5200 gs=2 cs=0 l=1 c_cookie=229661837484603493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc174167d40 tx=0x7fc16801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fec3971bbb865 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc171ffb640 1 -- 10.20.193.40:0/360354458 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc1680a6040 con 0x7fc17415a010 2026-02-24T17:30:30.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc171ffb640 1 -- 10.20.193.40:0/360354458 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1680af070 con 0x7fc17415a010 2026-02-24T17:30:30.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc171ffb640 1 -- 10.20.193.40:0/360354458 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc1680aa8a0 con 0x7fc17415a010 2026-02-24T17:30:30.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- 10.20.193.40:0/360354458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc17415a010 msgr2=0x7fc1740565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 --2- 10.20.193.40:0/360354458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc17415a010 0x7fc1740565f0 secure :-1 s=READY pgs=5200 gs=2 cs=0 l=1 c_cookie=229661837484603493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc174167d40 tx=0x7fc16801c520 comp rx=0 tx=0).stop 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- 10.20.193.40:0/360354458 shutdown_connections 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 --2- 10.20.193.40:0/360354458 >> v2:10.20.193.94:3300/0 conn(0x7fc174167350 0x7fc1740b42c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 --2- 10.20.193.40:0/360354458 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc17415a010 0x7fc1740565f0 unknown :-1 s=CLOSED pgs=5200 gs=2 cs=0 l=1 c_cookie=229661837484603493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- 10.20.193.40:0/360354458 >> 10.20.193.40:0/360354458 conn(0x7fc1740b8fd0 msgr2=0x7fc1740b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- 10.20.193.40:0/360354458 shutdown_connections 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- 10.20.193.40:0/360354458 wait complete. 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 librados: starting msgr at 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 librados: starting objecter 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 Processor -- start 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- start start 2026-02-24T17:30:30.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 librados: setting wanted keys 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 librados: calling monclient init 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc17415a010 0x7fc174122780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc174164b40 0x7fc174166830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc174167350 0x7fc174136220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc17415a560 con 0x7fc174164b40 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fc17415a3e0 con 0x7fc17415a010 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1797c8640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fc174164fa0 con 0x7fc174167350 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.875+0000 7fc1727fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc174164b40 0x7fc174166830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1727fc640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc174164b40 0x7fc174166830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57846/0 (socket says 10.20.193.40:57846) 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1727fc640 1 -- 10.20.193.40:0/1258213353 learned_addr learned my addr 10.20.193.40:0/1258213353 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:30.882 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1737fe640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc174167350 0x7fc174136220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc172ffd640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc17415a010 0x7fc174122780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1727fc640 1 -- 10.20.193.40:0/1258213353 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc174167350 msgr2=0x7fc174136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1727fc640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc174167350 0x7fc174136220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1727fc640 1 -- 10.20.193.40:0/1258213353 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc17415a010 msgr2=0x7fc174122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1727fc640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc17415a010 0x7fc174122780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1727fc640 1 -- 10.20.193.40:0/1258213353 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc174135180 con 0x7fc174164b40 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1727fc640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc174164b40 0x7fc174166830 secure :-1 s=READY pgs=5201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc15c00c550 tx=0x7fc15c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 10 client.?.objecter ms_handle_connect 0x7fc174164b40 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 1 -- 10.20.193.40:0/1258213353 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc15c006af0 con 0x7fc174164b40 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 1 -- 10.20.193.40:0/1258213353 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c006c90 con 0x7fc174164b40 2026-02-24T17:30:30.883 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc174135460 con 0x7fc174164b40 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 1 -- 10.20.193.40:0/1258213353 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc15c007270 con 0x7fc174164b40 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1797c8640 10 client.25446.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc174135a20 con 0x7fc174164b40 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1797c8640 1 librados: init done 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc174058160 con 0x7fc174164b40 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 1 -- 10.20.193.40:0/1258213353 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fc15c023060 con 0x7fc174164b40 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 1 --2- 10.20.193.40:0/1258213353 >> v2:10.20.193.120:6800/397309233 conn(0x7fc140074100 0x7fc1400945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 1 -- 10.20.193.40:0/1258213353 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fc15c096410 con 0x7fc174164b40 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 10 client.25446.objecter ms_dispatch2 0x7fc174000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 3 client.25446.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 3 client.25446.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:30.884 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc172ffd640 1 --2- 10.20.193.40:0/1258213353 >> v2:10.20.193.120:6800/397309233 conn(0x7fc140074100 0x7fc1400945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:30.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 20 client.25446.objecter dump_active .. 0 homeless 2026-02-24T17:30:30.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc172ffd640 1 --2- 10.20.193.40:0/1258213353 >> v2:10.20.193.120:6800/397309233 conn(0x7fc140074100 0x7fc1400945b0 secure :-1 s=READY pgs=2252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc16801cdc0 tx=0x7fc1680a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:30.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.879+0000 7fc1537fe640 10 client.25446.objecter ms_handle_connect 0x7fc140074100 2026-02-24T17:30:30.885 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.883+0000 7fc1537fe640 1 -- 10.20.193.40:0/1258213353 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fc15c0604a0 con 0x7fc174164b40 2026-02-24T17:30:30.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7fc1740605d0 con 0x7fc140074100 2026-02-24T17:30:30.972 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1537fe640 1 -- 10.20.193.40:0/1258213353 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fc1740605d0 con 0x7fc140074100 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 10 to deep-scrub 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 10 librados: watch_flush enter 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 10 librados: watch_flush exit 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 20 client.25446.objecter shutdown clearing up homeless session... 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 10 client.25446.objecter successfully canceled tick 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 >> v2:10.20.193.120:6800/397309233 conn(0x7fc140074100 msgr2=0x7fc1400945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 --2- 10.20.193.40:0/1258213353 >> v2:10.20.193.120:6800/397309233 conn(0x7fc140074100 0x7fc1400945b0 secure :-1 s=READY pgs=2252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc16801cdc0 tx=0x7fc1680a7000 comp rx=0 tx=0).stop 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc174164b40 msgr2=0x7fc174166830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc174164b40 0x7fc174166830 secure :-1 s=READY pgs=5201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc15c00c550 tx=0x7fc15c00ca10 comp rx=0 tx=0).stop 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 shutdown_connections 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 --2- 10.20.193.40:0/1258213353 >> v2:10.20.193.120:6800/397309233 conn(0x7fc140074100 0x7fc1400945b0 unknown :-1 s=CLOSED pgs=2252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fc174167350 0x7fc174136220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fc174164b40 0x7fc174166830 unknown :-1 s=CLOSED pgs=5201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 --2- 10.20.193.40:0/1258213353 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fc17415a010 0x7fc174122780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 >> 10.20.193.40:0/1258213353 conn(0x7fc1740b8fd0 msgr2=0x7fc1740b93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 shutdown_connections 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 -- 10.20.193.40:0/1258213353 wait complete. 2026-02-24T17:30:30.973 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:30.971+0000 7fc1797c8640 1 librados: shutdown 2026-02-24T17:30:30.983 INFO:tasks.ceph:Scrubbing osd.14 2026-02-24T17:30:30.984 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:31.056 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.055+0000 7fd59b9a6640 1 Processor -- start 2026-02-24T17:30:31.057 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.055+0000 7fd59b9a6640 1 -- start start 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fd594161ad0 0x7fd5940b16a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fd5940b1be0 0x7fd5940b3fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5940b3560 con 0x7fd594161700 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd5940b3b40 con 0x7fd5940b1be0 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fd59416b750 con 0x7fd594161ad0 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd599f1c640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fd5940b1be0 0x7fd5940b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd599f1c640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fd5940b1be0 0x7fd5940b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57860/0 (socket says 10.20.193.40:57860) 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd599f1c640 1 -- 10.20.193.40:0/3402681095 learned_addr learned my addr 10.20.193.40:0/3402681095 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd598f1a640 1 --2- 10.20.193.40:0/3402681095 >> v2:10.20.193.94:3300/0 conn(0x7fd594161ad0 0x7fd5940b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd599f1c640 1 -- 10.20.193.40:0/3402681095 >> v2:10.20.193.94:3300/0 conn(0x7fd594161ad0 msgr2=0x7fd5940b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd599f1c640 1 --2- 10.20.193.40:0/3402681095 >> v2:10.20.193.94:3300/0 conn(0x7fd594161ad0 0x7fd5940b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd599f1c640 1 -- 10.20.193.40:0/3402681095 >> v1:10.20.193.109:6789/0 conn(0x7fd594161700 legacy=0x7fd59416af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.058 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd599f1c640 1 -- 10.20.193.40:0/3402681095 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59416ba30 con 0x7fd5940b1be0 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd599f1c640 1 --2- 10.20.193.40:0/3402681095 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd5940b1be0 0x7fd5940b3fd0 secure :-1 s=READY pgs=5202 gs=2 cs=0 l=1 c_cookie=4488667255987473203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5940b8520 tx=0x7fd59001d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4af3165c0f8b33 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd583fff640 1 -- 10.20.193.40:0/3402681095 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5900b3070 con 0x7fd5940b1be0 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd583fff640 1 -- 10.20.193.40:0/3402681095 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5900a6a40 con 0x7fd5940b1be0 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd583fff640 1 -- 10.20.193.40:0/3402681095 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5900a6e50 con 0x7fd5940b1be0 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- 10.20.193.40:0/3402681095 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd5940b1be0 msgr2=0x7fd5940b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 --2- 10.20.193.40:0/3402681095 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd5940b1be0 0x7fd5940b3fd0 secure :-1 s=READY pgs=5202 gs=2 cs=0 l=1 c_cookie=4488667255987473203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5940b8520 tx=0x7fd59001d960 comp rx=0 tx=0).stop 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- 10.20.193.40:0/3402681095 shutdown_connections 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 --2- 10.20.193.40:0/3402681095 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd5940b1be0 0x7fd5940b3fd0 unknown :-1 s=CLOSED pgs=5202 gs=2 cs=0 l=1 c_cookie=4488667255987473203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.059 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 --2- 10.20.193.40:0/3402681095 >> v2:10.20.193.94:3300/0 conn(0x7fd594161ad0 0x7fd5940b16a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- 10.20.193.40:0/3402681095 >> 10.20.193.40:0/3402681095 conn(0x7fd5940b58a0 msgr2=0x7fd5940b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- 10.20.193.40:0/3402681095 shutdown_connections 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- 10.20.193.40:0/3402681095 wait complete. 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 librados: starting msgr at 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 librados: starting objecter 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 Processor -- start 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 -- start start 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 librados: setting wanted keys 2026-02-24T17:30:31.060 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.059+0000 7fd59b9a6640 1 librados: calling monclient init 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd5940b1be0 0x7fd59417f120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd594161700 0x7fd59416d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd594161ad0 0x7fd59416ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd59416f350 con 0x7fd594161700 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fd59416f1d0 con 0x7fd5940b1be0 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fd5941d1840 con 0x7fd594161ad0 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd594161700 0x7fd59416d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd594161700 0x7fd59416d870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57870/0 (socket says 10.20.193.40:57870) 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 -- 10.20.193.40:0/101274482 learned_addr learned my addr 10.20.193.40:0/101274482 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd599f1c640 1 --2- 10.20.193.40:0/101274482 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd594161ad0 0x7fd59416ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59971b640 1 --2- 10.20.193.40:0/101274482 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd5940b1be0 0x7fd59417f120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 -- 10.20.193.40:0/101274482 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd594161ad0 msgr2=0x7fd59416ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 --2- 10.20.193.40:0/101274482 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fd594161ad0 0x7fd59416ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 -- 10.20.193.40:0/101274482 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd5940b1be0 msgr2=0x7fd59417f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 --2- 10.20.193.40:0/101274482 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fd5940b1be0 0x7fd59417f120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.062 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 -- 10.20.193.40:0/101274482 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59416c4f0 con 0x7fd594161700 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd598f1a640 1 --2- 10.20.193.40:0/101274482 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd594161700 0x7fd59416d870 secure :-1 s=READY pgs=5203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd588006b80 tx=0x7fd58800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 10 client.?.objecter ms_handle_connect 0x7fd594161700 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd588017070 con 0x7fd594161700 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58800ee50 con 0x7fd594161700 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd58800f040 con 0x7fd594161700 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59416c7d0 con 0x7fd594161700 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 10 client.25452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59416cd90 con 0x7fd594161700 2026-02-24T17:30:31.063 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 librados: init done 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 10 client.25452.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 15 client.25452.objecter _session_command_op_assign -1 1 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 20 client.25452.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 10 client.25452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd59416c2a0 con 0x7fd594161700 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fd588012050 con 0x7fd594161700 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 --2- 10.20.193.40:0/101274482 >> v2:10.20.193.120:6800/397309233 conn(0x7fd564074100 0x7fd5640945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fd588096380 con 0x7fd594161700 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 10 client.25452.objecter ms_dispatch2 0x7fd594000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 3 client.25452.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 3 client.25452.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 10 client.25452.objecter checking command 1 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 --2- 10.20.193.40:0/101274482 >> v2:10.20.193.109:6801/1905173416 conn(0x7fd56409b440 0x7fd5640bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 20 client.25452.objecter _get_session s=0x7fd56409ad90 osd=14 3 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 20 client.25452.objecter put_session s=0x7fd56409ad90 osd=14 3 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 15 client.25452.objecter _session_command_op_remove -1 1 2026-02-24T17:30:31.064 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 20 client.25452.objecter _get_session s=0x7fd56409ad90 osd=14 3 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 20 client.25452.objecter get_session s=0x7fd56409ad90 osd=14 3 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 15 client.25452.objecter _session_command_op_assign 14 1 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 20 client.25452.objecter put_session s=0x7fd56409ad90 osd=14 4 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 10 client.25452.objecter _send_command 1 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 --> v2:10.20.193.109:6801/1905173416 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd588025e50 con 0x7fd56409b440 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 20 client.25452.objecter dump_active .. 0 homeless 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fd5880967e0 con 0x7fd594161700 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59971b640 1 --2- 10.20.193.40:0/101274482 >> v2:10.20.193.120:6800/397309233 conn(0x7fd564074100 0x7fd5640945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd599f1c640 1 --2- 10.20.193.40:0/101274482 >> v2:10.20.193.109:6801/1905173416 conn(0x7fd56409b440 0x7fd5640bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd59971b640 1 --2- 10.20.193.40:0/101274482 >> v2:10.20.193.120:6800/397309233 conn(0x7fd564074100 0x7fd5640945b0 secure :-1 s=READY pgs=2253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd584002810 tx=0x7fd5840026e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 10 client.25452.objecter ms_handle_connect 0x7fd564074100 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd581ffb640 10 client.25452.objecter ms_handle_connect 0x7fd56409b440 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.063+0000 7fd599f1c640 1 --2- 10.20.193.40:0/101274482 >> v2:10.20.193.109:6801/1905173416 conn(0x7fd56409b440 0x7fd5640bb8d0 crc :-1 s=READY pgs=87 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.067+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 <== osd.14 v2:10.20.193.109:6801/1905173416 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fd588025e50 con 0x7fd56409b440 2026-02-24T17:30:31.065 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.067+0000 7fd581ffb640 10 client.25452.objecter ms_dispatch2 0x7fd594000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:31.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.067+0000 7fd581ffb640 10 client.25452.objecter _finish_command 1 = system:0 2026-02-24T17:30:31.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.067+0000 7fd581ffb640 20 client.25452.objecter put_session s=0x7fd56409ad90 osd=14 4 2026-02-24T17:30:31.066 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.067+0000 7fd581ffb640 15 client.25452.objecter _session_command_op_remove 14 1 2026-02-24T17:30:31.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 10 client.25452.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:31.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 15 client.25452.objecter _session_command_op_assign -1 2 2026-02-24T17:30:31.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 20 client.25452.objecter _get_session s=0x7fd56409ad90 osd=14 3 2026-02-24T17:30:31.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 20 client.25452.objecter put_session s=0x7fd56409ad90 osd=14 3 2026-02-24T17:30:31.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 20 client.25452.objecter _get_session s=0x7fd56409ad90 osd=14 3 2026-02-24T17:30:31.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 15 client.25452.objecter _session_command_op_remove -1 2 2026-02-24T17:30:31.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 20 client.25452.objecter get_session s=0x7fd56409ad90 osd=14 3 2026-02-24T17:30:31.072 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 15 client.25452.objecter _session_command_op_assign 14 2 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 20 client.25452.objecter put_session s=0x7fd56409ad90 osd=14 4 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 10 client.25452.objecter _send_command 2 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 --> v2:10.20.193.109:6801/1905173416 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd5940b3fd0 con 0x7fd56409b440 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd581ffb640 1 -- 10.20.193.40:0/101274482 <== osd.14 v2:10.20.193.109:6801/1905173416 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd5940b3fd0 con 0x7fd56409b440 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd581ffb640 10 client.25452.objecter ms_dispatch2 0x7fd594000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd581ffb640 10 client.25452.objecter _finish_command 2 = system:0 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd581ffb640 20 client.25452.objecter put_session s=0x7fd56409ad90 osd=14 4 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd581ffb640 15 client.25452.objecter _session_command_op_remove 14 2 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:31.073 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 10 librados: watch_flush enter 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 10 librados: watch_flush exit 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 10 client.25452.objecter close_session for osd.14 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 >> v2:10.20.193.109:6801/1905173416 conn(0x7fd56409b440 msgr2=0x7fd5640bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 --2- 10.20.193.40:0/101274482 >> v2:10.20.193.109:6801/1905173416 conn(0x7fd56409b440 0x7fd5640bb8d0 crc :-1 s=READY pgs=87 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 20 client.25452.objecter put_session s=0x7fd56409ad90 osd=14 1 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 20 client.25452.objecter shutdown clearing up homeless session... 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 10 client.25452.objecter successfully canceled tick 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 >> v2:10.20.193.120:6800/397309233 conn(0x7fd564074100 msgr2=0x7fd5640945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 --2- 10.20.193.40:0/101274482 >> v2:10.20.193.120:6800/397309233 conn(0x7fd564074100 0x7fd5640945b0 secure :-1 s=READY pgs=2253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd584002810 tx=0x7fd5840026e0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd594161700 msgr2=0x7fd59416d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 --2- 10.20.193.40:0/101274482 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fd594161700 0x7fd59416d870 secure :-1 s=READY pgs=5203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd588006b80 tx=0x7fd58800ec00 comp rx=0 tx=0).stop 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd599f1c640 1 -- 10.20.193.40:0/101274482 reap_dead start 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 shutdown_connections 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 >> 10.20.193.40:0/101274482 conn(0x7fd5940b58a0 msgr2=0x7fd59415d490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 shutdown_connections 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 -- 10.20.193.40:0/101274482 wait complete. 2026-02-24T17:30:31.074 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.071+0000 7fd59b9a6640 1 librados: shutdown 2026-02-24T17:30:31.081 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-24T17:30:31.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.139+0000 7f190f4cf640 1 Processor -- start 2026-02-24T17:30:31.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.139+0000 7f190f4cf640 1 -- start start 2026-02-24T17:30:31.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f19080b2500 0x7f19080b28d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f19080b4320 0x7f19080b4740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19081651b0 con 0x7f1908168840 2026-02-24T17:30:31.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f1908165490 con 0x7f19080b4320 2026-02-24T17:30:31.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f1908165770 con 0x7f19080b2500 2026-02-24T17:30:31.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f19080b4320 0x7f19080b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f19080b4320 0x7f19080b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57884/0 (socket says 10.20.193.40:57884) 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 -- 10.20.193.40:0/3845782816 learned_addr learned my addr 10.20.193.40:0/3845782816 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190d244640 1 --2- 10.20.193.40:0/3845782816 >> v2:10.20.193.109:3300/0 conn(0x7f19080b2500 0x7f19080b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190ca43640 1 -- 10.20.193.40:0/3845782816 >> v1:10.20.193.109:6789/0 conn(0x7f1908168840 legacy=0x7f1908164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190ca43640 1 -- 10.20.193.40:0/3845782816 >> v1:10.20.193.109:6789/0 conn(0x7f1908168840 legacy=0x7f1908164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190ca43640 1 --1- 10.20.193.40:0/3845782816 >> v1:10.20.193.109:6789/0 conn(0x7f1908168840 0x7f1908164910 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=1 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 -- 10.20.193.40:0/3845782816 >> v2:10.20.193.109:3300/0 conn(0x7f19080b2500 msgr2=0x7f19080b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 --2- 10.20.193.40:0/3845782816 >> v2:10.20.193.109:3300/0 conn(0x7f19080b2500 0x7f19080b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 -- 10.20.193.40:0/3845782816 >> v1:10.20.193.109:6789/0 conn(0x7f1908168840 legacy=0x7f1908164910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 -- 10.20.193.40:0/3845782816 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19080b3560 con 0x7f19080b4320 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 --2- 10.20.193.40:0/3845782816 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19080b4320 0x7f19080b4740 secure :-1 s=READY pgs=5204 gs=2 cs=0 l=1 c_cookie=2823893697243328205 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19080b88b0 tx=0x7f190401d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27307c5b23a72ecd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f18f7fff640 1 -- 10.20.193.40:0/3845782816 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19040b3070 con 0x7f19080b4320 2026-02-24T17:30:31.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f18f7fff640 1 -- 10.20.193.40:0/3845782816 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19040a6880 con 0x7f19080b4320 2026-02-24T17:30:31.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f18f7fff640 1 -- 10.20.193.40:0/3845782816 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19040a6c90 con 0x7f19080b4320 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- 10.20.193.40:0/3845782816 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19080b4320 msgr2=0x7f19080b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3845782816 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19080b4320 0x7f19080b4740 secure :-1 s=READY pgs=5204 gs=2 cs=0 l=1 c_cookie=2823893697243328205 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19080b88b0 tx=0x7f190401d900 comp rx=0 tx=0).stop 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- 10.20.193.40:0/3845782816 shutdown_connections 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3845782816 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f19080b4320 0x7f19080b4740 unknown :-1 s=CLOSED pgs=5204 gs=2 cs=0 l=1 c_cookie=2823893697243328205 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3845782816 >> v2:10.20.193.109:3300/0 conn(0x7f19080b2500 0x7f19080b28d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- 10.20.193.40:0/3845782816 >> 10.20.193.40:0/3845782816 conn(0x7f19080b8fd0 msgr2=0x7f19080b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- 10.20.193.40:0/3845782816 shutdown_connections 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- 10.20.193.40:0/3845782816 wait complete. 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 librados: starting msgr at 2026-02-24T17:30:31.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 librados: starting objecter 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 Processor -- start 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- start start 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 librados: setting wanted keys 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 librados: calling monclient init 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19080b2500 0x7f1908120a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19080b4320 0x7f1908120f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1908168840 0x7f1908124b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f19080567f0 con 0x7f1908168840 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f1908168c80 con 0x7f19080b4320 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190f4cf640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f19081221f0 con 0x7f19080b2500 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.143+0000 7f190da45640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1908168840 0x7f1908124b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190da45640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1908168840 0x7f1908124b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:57894/0 (socket says 10.20.193.40:57894) 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190da45640 1 -- 10.20.193.40:0/3765356806 learned_addr learned my addr 10.20.193.40:0/3765356806 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190d244640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19080b2500 0x7f1908120a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190ca43640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19080b4320 0x7f1908120f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190da45640 1 -- 10.20.193.40:0/3765356806 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19080b2500 msgr2=0x7f1908120a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190da45640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19080b2500 0x7f1908120a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190da45640 1 -- 10.20.193.40:0/3765356806 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19080b4320 msgr2=0x7f1908120f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190da45640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19080b4320 0x7f1908120f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190da45640 1 -- 10.20.193.40:0/3765356806 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19081c9010 con 0x7f1908168840 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190da45640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1908168840 0x7f1908124b60 secure :-1 s=READY pgs=5205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f190401bfb0 tx=0x7f190401a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 10 client.?.objecter ms_handle_connect 0x7f1908168840 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:31.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 1 -- 10.20.193.40:0/3765356806 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19040b3040 con 0x7f1908168840 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 1 -- 10.20.193.40:0/3765356806 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19040ae660 con 0x7f1908168840 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190814a0d0 con 0x7f1908168840 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 1 -- 10.20.193.40:0/3765356806 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19040aea30 con 0x7f1908168840 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190f4cf640 10 client.25458.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190814a690 con 0x7f1908168840 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190f4cf640 1 librados: init done 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19080b28d0 con 0x7f1908168840 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 1 -- 10.20.193.40:0/3765356806 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f19040b6070 con 0x7f1908168840 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 1 --2- 10.20.193.40:0/3765356806 >> v2:10.20.193.120:6800/397309233 conn(0x7f18d8074100 0x7f18d80945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 1 -- 10.20.193.40:0/3765356806 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f1904131970 con 0x7f1908168840 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 10 client.25458.objecter ms_dispatch2 0x7f1908000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:31.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 3 client.25458.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:31.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 3 client.25458.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:31.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190d244640 1 --2- 10.20.193.40:0/3765356806 >> v2:10.20.193.120:6800/397309233 conn(0x7f18d8074100 0x7f18d80945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 20 client.25458.objecter dump_active .. 0 homeless 2026-02-24T17:30:31.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f190d244640 1 --2- 10.20.193.40:0/3765356806 >> v2:10.20.193.120:6800/397309233 conn(0x7f18d8074100 0x7f18d80945b0 secure :-1 s=READY pgs=2254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f8004780 tx=0x7f18f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.147+0000 7f18f5ffb640 10 client.25458.objecter ms_handle_connect 0x7f18d8074100 2026-02-24T17:30:31.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.151+0000 7f18f5ffb640 1 -- 10.20.193.40:0/3765356806 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f1904017580 con 0x7f1908168840 2026-02-24T17:30:31.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.235+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7f190803b110 con 0x7f18d8074100 2026-02-24T17:30:31.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.235+0000 7f18f5ffb640 1 -- 10.20.193.40:0/3765356806 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f18f800c440 con 0x7f18d8074100 2026-02-24T17:30:31.237 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 14 to deep-scrub 2026-02-24T17:30:31.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 10 librados: watch_flush enter 2026-02-24T17:30:31.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 10 librados: watch_flush exit 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 20 client.25458.objecter shutdown clearing up homeless session... 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 10 client.25458.objecter successfully canceled tick 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 >> v2:10.20.193.120:6800/397309233 conn(0x7f18d8074100 msgr2=0x7f18d80945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3765356806 >> v2:10.20.193.120:6800/397309233 conn(0x7f18d8074100 0x7f18d80945b0 secure :-1 s=READY pgs=2254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f8004780 tx=0x7f18f8008040 comp rx=0 tx=0).stop 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1908168840 msgr2=0x7f1908124b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1908168840 0x7f1908124b60 secure :-1 s=READY pgs=5205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f190401bfb0 tx=0x7f190401a6a0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 shutdown_connections 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3765356806 >> v2:10.20.193.120:6800/397309233 conn(0x7f18d8074100 0x7f18d80945b0 unknown :-1 s=CLOSED pgs=2254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f1908168840 0x7f1908124b60 unknown :-1 s=CLOSED pgs=5205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f19080b4320 0x7f1908120f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.239 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 --2- 10.20.193.40:0/3765356806 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f19080b2500 0x7f1908120a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 >> 10.20.193.40:0/3765356806 conn(0x7f19080b8fd0 msgr2=0x7f1908056b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 shutdown_connections 2026-02-24T17:30:31.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 -- 10.20.193.40:0/3765356806 wait complete. 2026-02-24T17:30:31.240 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.239+0000 7f190f4cf640 1 librados: shutdown 2026-02-24T17:30:31.249 INFO:tasks.ceph:Scrubbing osd.3 2026-02-24T17:30:31.249 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83d62f9640 1 Processor -- start 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83d62f9640 1 -- start start 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83d62f9640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f83d00b3fd0 0x7f83d00b4410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83d62f9640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d00b3560 con 0x7f83d0161700 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83d62f9640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d00b4950 con 0x7f83d0161ad0 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83d62f9640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f83d00b3b40 con 0x7f83d00b3fd0 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83cffff640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f83d0161700 0x7f83d016af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:58298/0 (socket says 10.20.193.40:58298) 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83cffff640 1 -- 10.20.193.40:0/4000719853 learned_addr learned my addr 10.20.193.40:0/4000719853 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:31.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740363343 0 0) 0x7f83d00b3560 con 0x7f83d0161700 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83d486f640 1 --2- 10.20.193.40:0/4000719853 >> v2:10.20.193.109:3300/0 conn(0x7f83d00b3fd0 0x7f83d00b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.319+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83b4003620 con 0x7f83d0161700 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3651978737 0 0) 0x7f83b4003620 con 0x7f83d0161700 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 >> v2:10.20.193.109:3300/0 conn(0x7f83d00b3fd0 msgr2=0x7f83d00b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 --2- 10.20.193.40:0/4000719853 >> v2:10.20.193.109:3300/0 conn(0x7f83d00b3fd0 0x7f83d00b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 >> v1:10.20.193.94:6789/0 conn(0x7f83d0161ad0 legacy=0x7f83d00b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d016b750 con 0x7f83d0161700 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f83bc002e80 con 0x7f83d0161700 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 >> v1:10.20.193.40:6789/0 conn(0x7f83d0161700 legacy=0x7f83d016af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83b4003ba0 0x7f83b4003fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b40048d0 0x7f83b4004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f83b40053a0 0x7f83b4065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00b3b40 con 0x7f83b4003ba0 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4066290 con 0x7f83b40048d0 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4066490 con 0x7f83b40053a0 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cffff640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83b4003ba0 0x7f83b4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d486f640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f83b40053a0 0x7f83b4065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cffff640 1 -- 10.20.193.40:0/4000719853 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f83b40053a0 msgr2=0x7f83b4065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cffff640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f83b40053a0 0x7f83b4065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cffff640 1 -- 10.20.193.40:0/4000719853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b40048d0 msgr2=0x7f83b4004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cf7fe640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b40048d0 0x7f83b4004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cffff640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b40048d0 0x7f83b4004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cffff640 1 -- 10.20.193.40:0/4000719853 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b4003620 con 0x7f83b4003ba0 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d486f640 1 -- 10.20.193.40:0/4000719853 reap_dead start 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cf7fe640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b40048d0 0x7f83b4004d40 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:30:31.322 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83cffff640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83b4003ba0 0x7f83b4003fb0 secure :-1 s=READY pgs=5207 gs=4 cs=0 l=1 c_cookie=3996831053375495840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83bc00c240 tx=0x7f83bc01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377798aabbb25ea0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83bc007db0 con 0x7f83b4003ba0 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc0a9020 con 0x7f83b4003ba0 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83ceffd640 1 -- 10.20.193.40:0/4000719853 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83bc005e10 con 0x7f83b4003ba0 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d62f9640 1 -- 10.20.193.40:0/4000719853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83b4003ba0 msgr2=0x7f83b4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d62f9640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83b4003ba0 0x7f83b4003fb0 secure :-1 s=READY pgs=5207 gs=4 cs=0 l=1 c_cookie=3996831053375495840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83bc00c240 tx=0x7f83bc01cc70 comp rx=0 tx=0).stop 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d62f9640 1 -- 10.20.193.40:0/4000719853 shutdown_connections 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d62f9640 1 --2- 10.20.193.40:0/4000719853 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83b4003ba0 0x7f83b4003fb0 unknown :-1 s=CLOSED pgs=5207 gs=4 cs=0 l=1 c_cookie=3996831053375495840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d62f9640 1 -- 10.20.193.40:0/4000719853 >> 10.20.193.40:0/4000719853 conn(0x7f83d00b58a0 msgr2=0x7f83d00b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d62f9640 1 -- 10.20.193.40:0/4000719853 shutdown_connections 2026-02-24T17:30:31.324 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.323+0000 7f83d62f9640 1 -- 10.20.193.40:0/4000719853 wait complete. 2026-02-24T17:30:31.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 librados: starting msgr at 2026-02-24T17:30:31.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 librados: starting objecter 2026-02-24T17:30:31.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 Processor -- start 2026-02-24T17:30:31.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 -- start start 2026-02-24T17:30:31.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 librados: setting wanted keys 2026-02-24T17:30:31.325 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 librados: calling monclient init 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b4003ba0 0x7f83d011c000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f83d00574d0 0x7f83d013c590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83d013cad0 0x7f83d012b520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f83d016f1d0 con 0x7f83d013cad0 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00b1eb0 con 0x7f83b4003ba0 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f83d016f350 con 0x7f83d00574d0 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83d013cad0 0x7f83d012b520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83d013cad0 0x7f83d012b520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32778/0 (socket says 10.20.193.40:32778) 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 -- 10.20.193.40:0/3254961761 learned_addr learned my addr 10.20.193.40:0/3254961761 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.326 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83cffff640 1 --2- 10.20.193.40:0/3254961761 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b4003ba0 0x7f83d011c000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83cf7fe640 1 --2- 10.20.193.40:0/3254961761 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f83d00574d0 0x7f83d013c590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 -- 10.20.193.40:0/3254961761 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f83d00574d0 msgr2=0x7f83d013c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 --2- 10.20.193.40:0/3254961761 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f83d00574d0 0x7f83d013c590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 -- 10.20.193.40:0/3254961761 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b4003ba0 msgr2=0x7f83d011c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 --2- 10.20.193.40:0/3254961761 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f83b4003ba0 0x7f83d011c000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 -- 10.20.193.40:0/3254961761 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d013cf70 con 0x7f83d013cad0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d486f640 1 --2- 10.20.193.40:0/3254961761 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83d013cad0 0x7f83d012b520 secure :-1 s=READY pgs=5208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83d00b5400 tx=0x7f83c4005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 10 client.?.objecter ms_handle_connect 0x7f83d013cad0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83c40089e0 con 0x7f83d013cad0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c401a070 con 0x7f83d013cad0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83c4008e00 con 0x7f83d013cad0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d0056450 con 0x7f83d013cad0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 10 client.25464.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d0056a10 con 0x7f83d013cad0 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 librados: init done 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 10 client.25464.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 15 client.25464.objecter _session_command_op_assign -1 1 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 20 client.25464.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 10 client.25464.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.327 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83d011def0 con 0x7f83d013cad0 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f83c401f460 con 0x7f83d013cad0 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 --2- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6800/397309233 conn(0x7f83a0074100 0x7f83a00945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f83c4097e20 con 0x7f83d013cad0 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 10 client.25464.objecter ms_dispatch2 0x7f83d0000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 3 client.25464.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 3 client.25464.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83cffff640 1 --2- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6800/397309233 conn(0x7f83a0074100 0x7f83a00945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 10 client.25464.objecter checking command 1 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 --2- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6806/679060341 conn(0x7f83a009b440 0x7f83a00bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 20 client.25464.objecter _get_session s=0x7f83a009ad90 osd=3 3 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 20 client.25464.objecter put_session s=0x7f83a009ad90 osd=3 3 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 15 client.25464.objecter _session_command_op_remove -1 1 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 20 client.25464.objecter _get_session s=0x7f83a009ad90 osd=3 3 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 20 client.25464.objecter get_session s=0x7f83a009ad90 osd=3 3 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 15 client.25464.objecter _session_command_op_assign 3 1 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 20 client.25464.objecter put_session s=0x7f83a009ad90 osd=3 4 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 10 client.25464.objecter _send_command 1 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 --> v2:10.20.193.120:6806/679060341 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83c4021e70 con 0x7f83a009b440 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 20 client.25464.objecter dump_active .. 0 homeless 2026-02-24T17:30:31.328 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7f83c4098280 con 0x7f83d013cad0 2026-02-24T17:30:31.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.327+0000 7f83cf7fe640 1 --2- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6806/679060341 conn(0x7f83a009b440 0x7f83a00bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83cffff640 1 --2- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6800/397309233 conn(0x7f83a0074100 0x7f83a00945b0 secure :-1 s=READY pgs=2255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83bc007ca0 tx=0x7f83bc0b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83ccff9640 10 client.25464.objecter ms_handle_connect 0x7f83a0074100 2026-02-24T17:30:31.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83ccff9640 10 client.25464.objecter ms_handle_connect 0x7f83a009b440 2026-02-24T17:30:31.329 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83cf7fe640 1 --2- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6806/679060341 conn(0x7f83a009b440 0x7f83a00bb8d0 crc :-1 s=READY pgs=79 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 <== osd.3 v2:10.20.193.120:6806/679060341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f83c4021e70 con 0x7f83a009b440 2026-02-24T17:30:31.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83ccff9640 10 client.25464.objecter ms_dispatch2 0x7f83d0000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:31.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83ccff9640 10 client.25464.objecter _finish_command 1 = system:0 2026-02-24T17:30:31.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83ccff9640 20 client.25464.objecter put_session s=0x7f83a009ad90 osd=3 4 2026-02-24T17:30:31.330 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.331+0000 7f83ccff9640 15 client.25464.objecter _session_command_op_remove 3 1 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 10 client.25464.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 15 client.25464.objecter _session_command_op_assign -1 2 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 20 client.25464.objecter _get_session s=0x7f83a009ad90 osd=3 3 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 20 client.25464.objecter put_session s=0x7f83a009ad90 osd=3 3 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 20 client.25464.objecter _get_session s=0x7f83a009ad90 osd=3 3 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 15 client.25464.objecter _session_command_op_remove -1 2 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 20 client.25464.objecter get_session s=0x7f83a009ad90 osd=3 3 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 15 client.25464.objecter _session_command_op_assign 3 2 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 20 client.25464.objecter put_session s=0x7f83a009ad90 osd=3 4 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 10 client.25464.objecter _send_command 2 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 --> v2:10.20.193.120:6806/679060341 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f83d016b330 con 0x7f83a009b440 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83ccff9640 1 -- 10.20.193.40:0/3254961761 <== osd.3 v2:10.20.193.120:6806/679060341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f83d016b330 con 0x7f83a009b440 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83ccff9640 10 client.25464.objecter ms_dispatch2 0x7f83d0000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83ccff9640 10 client.25464.objecter _finish_command 2 = system:0 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83ccff9640 20 client.25464.objecter put_session s=0x7f83a009ad90 osd=3 4 2026-02-24T17:30:31.337 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83ccff9640 15 client.25464.objecter _session_command_op_remove 3 2 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 10 librados: watch_flush enter 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 10 librados: watch_flush exit 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 10 client.25464.objecter close_session for osd.3 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6806/679060341 conn(0x7f83a009b440 msgr2=0x7f83a00bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 --2- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6806/679060341 conn(0x7f83a009b440 0x7f83a00bb8d0 crc :-1 s=READY pgs=79 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 20 client.25464.objecter put_session s=0x7f83a009ad90 osd=3 1 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 20 client.25464.objecter shutdown clearing up homeless session... 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 10 client.25464.objecter successfully canceled tick 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6800/397309233 conn(0x7f83a0074100 msgr2=0x7f83a00945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 --2- 10.20.193.40:0/3254961761 >> v2:10.20.193.120:6800/397309233 conn(0x7f83a0074100 0x7f83a00945b0 secure :-1 s=READY pgs=2255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83bc007ca0 tx=0x7f83bc0b1040 comp rx=0 tx=0).stop 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83d013cad0 msgr2=0x7f83d012b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 --2- 10.20.193.40:0/3254961761 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f83d013cad0 0x7f83d012b520 secure :-1 s=READY pgs=5208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83d00b5400 tx=0x7f83c4005a90 comp rx=0 tx=0).stop 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d486f640 1 -- 10.20.193.40:0/3254961761 reap_dead start 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 shutdown_connections 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 >> 10.20.193.40:0/3254961761 conn(0x7f83d00b58a0 msgr2=0x7f83d00b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 shutdown_connections 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 -- 10.20.193.40:0/3254961761 wait complete. 2026-02-24T17:30:31.338 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.339+0000 7f83d62f9640 1 librados: shutdown 2026-02-24T17:30:31.346 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-24T17:30:31.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.415+0000 7ffb5add5640 1 Processor -- start 2026-02-24T17:30:31.417 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.415+0000 7ffb5add5640 1 -- start start 2026-02-24T17:30:31.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7ffb540b2500 0x7ffb540b28d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7ffb54168840 0x7ffb54164910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7ffb540b4320 0x7ffb540b4740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7ffb541651b0 con 0x7ffb540b4320 2026-02-24T17:30:31.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7ffb54165490 con 0x7ffb540b2500 2026-02-24T17:30:31.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7ffb54165770 con 0x7ffb54168840 2026-02-24T17:30:31.419 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7ffb540b4320 0x7ffb540b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7ffb540b4320 0x7ffb540b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32792/0 (socket says 10.20.193.40:32792) 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 -- 10.20.193.40:0/1292427307 learned_addr learned my addr 10.20.193.40:0/1292427307 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb4bfff640 1 --2- 10.20.193.40:0/1292427307 >> v2:10.20.193.109:3300/0 conn(0x7ffb54168840 0x7ffb54164910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb58b4a640 1 --2- 10.20.193.40:0/1292427307 >> v2:10.20.193.94:3300/0 conn(0x7ffb540b2500 0x7ffb540b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 -- 10.20.193.40:0/1292427307 >> v2:10.20.193.109:3300/0 conn(0x7ffb54168840 msgr2=0x7ffb54164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 --2- 10.20.193.40:0/1292427307 >> v2:10.20.193.109:3300/0 conn(0x7ffb54168840 0x7ffb54164910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 -- 10.20.193.40:0/1292427307 >> v2:10.20.193.94:3300/0 conn(0x7ffb540b2500 msgr2=0x7ffb540b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 --2- 10.20.193.40:0/1292427307 >> v2:10.20.193.94:3300/0 conn(0x7ffb540b2500 0x7ffb540b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.420 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 -- 10.20.193.40:0/1292427307 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb540b3560 con 0x7ffb540b4320 2026-02-24T17:30:31.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5934b640 1 --2- 10.20.193.40:0/1292427307 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb540b4740 secure :-1 s=READY pgs=5209 gs=1 cs=0 l=1 c_cookie=17817431175674672015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb541656a0 tx=0x7ffb5001d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7443b40e40f338f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb4b7fe640 1 -- 10.20.193.40:0/1292427307 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb500b3070 con 0x7ffb540b4320 2026-02-24T17:30:31.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb4b7fe640 1 -- 10.20.193.40:0/1292427307 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb500a6880 con 0x7ffb540b4320 2026-02-24T17:30:31.421 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb4b7fe640 1 -- 10.20.193.40:0/1292427307 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb500a6c90 con 0x7ffb540b4320 2026-02-24T17:30:31.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- 10.20.193.40:0/1292427307 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 msgr2=0x7ffb540b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1292427307 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb540b4740 secure :-1 s=READY pgs=5209 gs=1 cs=0 l=1 c_cookie=17817431175674672015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb541656a0 tx=0x7ffb5001d8c0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- 10.20.193.40:0/1292427307 shutdown_connections 2026-02-24T17:30:31.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1292427307 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb540b4740 unknown :-1 s=CLOSED pgs=5209 gs=1 cs=0 l=1 c_cookie=17817431175674672015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1292427307 >> v2:10.20.193.109:3300/0 conn(0x7ffb54168840 0x7ffb54164910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.425 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1292427307 >> v2:10.20.193.94:3300/0 conn(0x7ffb540b2500 0x7ffb540b28d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- 10.20.193.40:0/1292427307 >> 10.20.193.40:0/1292427307 conn(0x7ffb540b8fd0 msgr2=0x7ffb540b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- 10.20.193.40:0/1292427307 shutdown_connections 2026-02-24T17:30:31.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- 10.20.193.40:0/1292427307 wait complete. 2026-02-24T17:30:31.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 librados: starting msgr at 2026-02-24T17:30:31.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 librados: starting objecter 2026-02-24T17:30:31.426 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 Processor -- start 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 -- start start 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 librados: setting wanted keys 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.419+0000 7ffb5add5640 1 librados: calling monclient init 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ffb540b2500 0x7ffb541666a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb54150c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ffb54168840 0x7ffb54166de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffb540567f0 con 0x7ffb540b4320 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ffb54164e50 con 0x7ffb54168840 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ffb54160900 con 0x7ffb540b2500 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb54150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.427 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb54150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32808/0 (socket says 10.20.193.40:32808) 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 -- 10.20.193.40:0/1925272641 learned_addr learned my addr 10.20.193.40:0/1925272641 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb58b4a640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ffb540b2500 0x7ffb541666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5934b640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ffb54168840 0x7ffb54166de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 -- 10.20.193.40:0/1925272641 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ffb540b2500 msgr2=0x7ffb541666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ffb540b2500 0x7ffb541666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 -- 10.20.193.40:0/1925272641 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ffb54168840 msgr2=0x7ffb54166de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ffb54168840 0x7ffb54166de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 -- 10.20.193.40:0/1925272641 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb54166be0 con 0x7ffb540b4320 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb4bfff640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb54150c00 secure :-1 s=READY pgs=5210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb3c00e7e0 tx=0x7ffb3c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 10 client.?.objecter ms_handle_connect 0x7ffb540b4320 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 1 -- 10.20.193.40:0/1925272641 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb3c017070 con 0x7ffb540b4320 2026-02-24T17:30:31.428 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 1 -- 10.20.193.40:0/1925272641 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3c00c8f0 con 0x7ffb540b4320 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 1 -- 10.20.193.40:0/1925272641 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb3c00f040 con 0x7ffb540b4320 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb541c9010 con 0x7ffb540b4320 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 10 client.25470.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb54167ac0 con 0x7ffb540b4320 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 librados: init done 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb54168c10 con 0x7ffb540b4320 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 1 -- 10.20.193.40:0/1925272641 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7ffb3c012050 con 0x7ffb540b4320 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 1 --2- 10.20.193.40:0/1925272641 >> v2:10.20.193.120:6800/397309233 conn(0x7ffb24074100 0x7ffb240945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 1 -- 10.20.193.40:0/1925272641 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7ffb3c095eb0 con 0x7ffb540b4320 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 10 client.25470.objecter ms_dispatch2 0x7ffb54000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:31.429 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 3 client.25470.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:31.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 3 client.25470.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:31.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 20 client.25470.objecter dump_active .. 0 homeless 2026-02-24T17:30:31.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb58b4a640 1 --2- 10.20.193.40:0/1925272641 >> v2:10.20.193.120:6800/397309233 conn(0x7ffb24074100 0x7ffb240945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb58b4a640 1 --2- 10.20.193.40:0/1925272641 >> v2:10.20.193.120:6800/397309233 conn(0x7ffb24074100 0x7ffb240945b0 secure :-1 s=READY pgs=2256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb5413f020 tx=0x7ffb44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.430 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.423+0000 7ffb497fa640 10 client.25470.objecter ms_handle_connect 0x7ffb24074100 2026-02-24T17:30:31.431 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.427+0000 7ffb497fa640 1 -- 10.20.193.40:0/1925272641 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7ffb3c05f8b0 con 0x7ffb540b4320 2026-02-24T17:30:31.512 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.511+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ffb5403b110 con 0x7ffb24074100 2026-02-24T17:30:31.513 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.511+0000 7ffb497fa640 1 -- 10.20.193.40:0/1925272641 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffb4400f830 con 0x7ffb24074100 2026-02-24T17:30:31.513 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 3 to deep-scrub 2026-02-24T17:30:31.514 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 10 librados: watch_flush enter 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 10 librados: watch_flush exit 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 20 client.25470.objecter shutdown clearing up homeless session... 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 10 client.25470.objecter successfully canceled tick 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 >> v2:10.20.193.120:6800/397309233 conn(0x7ffb24074100 msgr2=0x7ffb240945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1925272641 >> v2:10.20.193.120:6800/397309233 conn(0x7ffb24074100 0x7ffb240945b0 secure :-1 s=READY pgs=2256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb5413f020 tx=0x7ffb44008040 comp rx=0 tx=0).stop 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 msgr2=0x7ffb54150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb54150c00 secure :-1 s=READY pgs=5210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb3c00e7e0 tx=0x7ffb3c00eca0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 shutdown_connections 2026-02-24T17:30:31.515 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1925272641 >> v2:10.20.193.120:6800/397309233 conn(0x7ffb24074100 0x7ffb240945b0 unknown :-1 s=CLOSED pgs=2256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ffb54168840 0x7ffb54166de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ffb540b4320 0x7ffb54150c00 unknown :-1 s=CLOSED pgs=5210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 --2- 10.20.193.40:0/1925272641 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ffb540b2500 0x7ffb541666a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 >> 10.20.193.40:0/1925272641 conn(0x7ffb540b8fd0 msgr2=0x7ffb5415d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 shutdown_connections 2026-02-24T17:30:31.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 -- 10.20.193.40:0/1925272641 wait complete. 2026-02-24T17:30:31.516 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.515+0000 7ffb5add5640 1 librados: shutdown 2026-02-24T17:30:31.525 INFO:tasks.ceph:Scrubbing osd.7 2026-02-24T17:30:31.525 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:31.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.587+0000 7f07c4991640 1 Processor -- start 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.587+0000 7f07c4991640 1 -- start start 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f07c00aff60 0x7f07c00b0330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f07c00b41c0 0x7f07c0161200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c00b46d0 con 0x7f07c00b3d90 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f07c00b49b0 con 0x7f07c00aff60 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 -- --> v2:10.20.193.109:3300/0 -- mon_getmap magic: 0 -- 0x7f07c00b4c90 con 0x7f07c00b41c0 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bf577640 1 --2- >> v2:10.20.193.109:3300/0 conn(0x7f07c00b41c0 0x7f07c0161200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07be575640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7f07c00b3d90 0x7f07c00b6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:53430/0 (socket says 10.20.193.40:53430) 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07be575640 1 -- 10.20.193.40:0/697725602 learned_addr learned my addr 10.20.193.40:0/697725602 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:31.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bed76640 1 --2- 10.20.193.40:0/697725602 >> v2:10.20.193.94:3300/0 conn(0x7f07c00aff60 0x7f07c00b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.590 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bed76640 1 -- 10.20.193.40:0/697725602 >> v2:10.20.193.109:3300/0 conn(0x7f07c00b41c0 msgr2=0x7f07c0161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.590 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bed76640 1 --2- 10.20.193.40:0/697725602 >> v2:10.20.193.109:3300/0 conn(0x7f07c00b41c0 0x7f07c0161200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.590 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bed76640 1 -- 10.20.193.40:0/697725602 >> v1:10.20.193.94:6789/0 conn(0x7f07c00b3d90 legacy=0x7f07c00b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.590 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bed76640 1 -- 10.20.193.40:0/697725602 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c00b4f70 con 0x7f07c00aff60 2026-02-24T17:30:31.591 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bed76640 1 --2- 10.20.193.40:0/697725602 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00aff60 0x7f07c00b0330 secure :-1 s=READY pgs=5197 gs=2 cs=0 l=1 c_cookie=7206513360734326276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07c0165500 tx=0x7f07b401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6402adb847ad0e04 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.591 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bdd74640 1 -- 10.20.193.40:0/697725602 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07b40aa690 con 0x7f07c00aff60 2026-02-24T17:30:31.591 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bdd74640 1 -- 10.20.193.40:0/697725602 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b40af070 con 0x7f07c00aff60 2026-02-24T17:30:31.591 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07bdd74640 1 -- 10.20.193.40:0/697725602 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07b40aaa70 con 0x7f07c00aff60 2026-02-24T17:30:31.591 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 -- 10.20.193.40:0/697725602 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00aff60 msgr2=0x7f07c00b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.592 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 --2- 10.20.193.40:0/697725602 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00aff60 0x7f07c00b0330 secure :-1 s=READY pgs=5197 gs=2 cs=0 l=1 c_cookie=7206513360734326276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07c0165500 tx=0x7f07b401c4f0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.592 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 -- 10.20.193.40:0/697725602 shutdown_connections 2026-02-24T17:30:31.592 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 --2- 10.20.193.40:0/697725602 >> v2:10.20.193.109:3300/0 conn(0x7f07c00b41c0 0x7f07c0161200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.592 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 --2- 10.20.193.40:0/697725602 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00aff60 0x7f07c00b0330 unknown :-1 s=CLOSED pgs=5197 gs=2 cs=0 l=1 c_cookie=7206513360734326276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.592 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 -- 10.20.193.40:0/697725602 >> 10.20.193.40:0/697725602 conn(0x7f07c00b8900 msgr2=0x7f07c00b8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.592 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 -- 10.20.193.40:0/697725602 shutdown_connections 2026-02-24T17:30:31.592 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.591+0000 7f07c4991640 1 -- 10.20.193.40:0/697725602 wait complete. 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 librados: starting msgr at 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 librados: starting objecter 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 Processor -- start 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 -- start start 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 librados: setting wanted keys 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 librados: calling monclient init 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f07c00aff60 0x7f07c01202b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f07c00b3d90 0x7f07c0140e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00b41c0 0x7f07c0122630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01d1620 con 0x7f07c00aff60 2026-02-24T17:30:31.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f07c016bc40 con 0x7f07c00b41c0 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01d17a0 con 0x7f07c00b3d90 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f07c00aff60 0x7f07c01202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f07c00aff60 0x7f07c01202b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32824/0 (socket says 10.20.193.40:32824) 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 -- 10.20.193.40:0/3322862004 learned_addr learned my addr 10.20.193.40:0/3322862004 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07be575640 1 --2- 10.20.193.40:0/3322862004 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f07c00b3d90 0x7f07c0140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bf577640 1 --2- 10.20.193.40:0/3322862004 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00b41c0 0x7f07c0122630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 -- 10.20.193.40:0/3322862004 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f07c00b3d90 msgr2=0x7f07c0140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 --2- 10.20.193.40:0/3322862004 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f07c00b3d90 0x7f07c0140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 -- 10.20.193.40:0/3322862004 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00b41c0 msgr2=0x7f07c0122630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 --2- 10.20.193.40:0/3322862004 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00b41c0 0x7f07c0122630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 -- 10.20.193.40:0/3322862004 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c01cf400 con 0x7f07c00aff60 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bf577640 1 --2- 10.20.193.40:0/3322862004 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f07c00b41c0 0x7f07c0122630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bed76640 1 --2- 10.20.193.40:0/3322862004 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f07c00aff60 0x7f07c01202b0 secure :-1 s=READY pgs=5211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07b401ca60 tx=0x7f07b4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 10 client.?.objecter ms_handle_connect 0x7f07c00aff60 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07b40aa470 con 0x7f07c00aff60 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b40ba070 con 0x7f07c00aff60 2026-02-24T17:30:31.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07b40aa830 con 0x7f07c00aff60 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c013fa90 con 0x7f07c00aff60 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 10 client.25473.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c0140050 con 0x7f07c00aff60 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 librados: init done 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 10 client.25473.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 15 client.25473.objecter _session_command_op_assign -1 1 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 20 client.25473.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 10 client.25473.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07c0161200 con 0x7f07c00aff60 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f07b40aa9d0 con 0x7f07c00aff60 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 --2- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6800/397309233 conn(0x7f078c074100 0x7f078c0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f07b4130490 con 0x7f07c00aff60 2026-02-24T17:30:31.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 10 client.25473.objecter ms_dispatch2 0x7f07c0000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 3 client.25473.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 3 client.25473.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 10 client.25473.objecter checking command 1 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 --2- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6813/1724095478 conn(0x7f078c09b440 0x7f078c0bb8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 20 client.25473.objecter _get_session s=0x7f078c09ad90 osd=7 3 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 20 client.25473.objecter put_session s=0x7f078c09ad90 osd=7 3 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 15 client.25473.objecter _session_command_op_remove -1 1 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 20 client.25473.objecter _get_session s=0x7f078c09ad90 osd=7 3 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 20 client.25473.objecter get_session s=0x7f078c09ad90 osd=7 3 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 15 client.25473.objecter _session_command_op_assign 7 1 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 20 client.25473.objecter put_session s=0x7f078c09ad90 osd=7 4 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 10 client.25473.objecter _send_command 1 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 --> v2:10.20.193.120:6813/1724095478 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07b40ade80 con 0x7f078c09b440 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 20 client.25473.objecter dump_active .. 0 homeless 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7f07b4137050 con 0x7f07c00aff60 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07be575640 1 --2- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6800/397309233 conn(0x7f078c074100 0x7f078c0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07bf577640 1 --2- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6813/1724095478 conn(0x7f078c09b440 0x7f078c0bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f07be575640 1 --2- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6800/397309233 conn(0x7f078c074100 0x7f078c0945b0 secure :-1 s=READY pgs=2257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07c015ec10 tx=0x7f07a8007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.595+0000 7f079f7fe640 10 client.25473.objecter ms_handle_connect 0x7f078c074100 2026-02-24T17:30:31.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.599+0000 7f07bf577640 1 --2- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6813/1724095478 conn(0x7f078c09b440 0x7f078c0bb8d0 crc :-1 s=READY pgs=90 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.599+0000 7f079f7fe640 10 client.25473.objecter ms_handle_connect 0x7f078c09b440 2026-02-24T17:30:31.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.599+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 <== osd.7 v2:10.20.193.120:6813/1724095478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f07b40ade80 con 0x7f078c09b440 2026-02-24T17:30:31.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.599+0000 7f079f7fe640 10 client.25473.objecter ms_dispatch2 0x7f07c0000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:31.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.599+0000 7f079f7fe640 10 client.25473.objecter _finish_command 1 = system:0 2026-02-24T17:30:31.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.599+0000 7f079f7fe640 20 client.25473.objecter put_session s=0x7f078c09ad90 osd=7 4 2026-02-24T17:30:31.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.599+0000 7f079f7fe640 15 client.25473.objecter _session_command_op_remove 7 1 2026-02-24T17:30:31.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 10 client.25473.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:31.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 15 client.25473.objecter _session_command_op_assign -1 2 2026-02-24T17:30:31.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 20 client.25473.objecter _get_session s=0x7f078c09ad90 osd=7 3 2026-02-24T17:30:31.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 20 client.25473.objecter put_session s=0x7f078c09ad90 osd=7 3 2026-02-24T17:30:31.606 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 20 client.25473.objecter _get_session s=0x7f078c09ad90 osd=7 3 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 15 client.25473.objecter _session_command_op_remove -1 2 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 20 client.25473.objecter get_session s=0x7f078c09ad90 osd=7 3 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 15 client.25473.objecter _session_command_op_assign 7 2 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 20 client.25473.objecter put_session s=0x7f078c09ad90 osd=7 4 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 10 client.25473.objecter _send_command 2 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 --> v2:10.20.193.120:6813/1724095478 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f07c00604a0 con 0x7f078c09b440 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f079f7fe640 1 -- 10.20.193.40:0/3322862004 <== osd.7 v2:10.20.193.120:6813/1724095478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f07c00604a0 con 0x7f078c09b440 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f079f7fe640 10 client.25473.objecter ms_dispatch2 0x7f07c0000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f079f7fe640 10 client.25473.objecter _finish_command 2 = system:0 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f079f7fe640 20 client.25473.objecter put_session s=0x7f078c09ad90 osd=7 4 2026-02-24T17:30:31.607 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f079f7fe640 15 client.25473.objecter _session_command_op_remove 7 2 2026-02-24T17:30:31.608 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:31.608 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:31.608 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 10 librados: watch_flush enter 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 10 librados: watch_flush exit 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 10 client.25473.objecter close_session for osd.7 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6813/1724095478 conn(0x7f078c09b440 msgr2=0x7f078c0bb8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 --2- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6813/1724095478 conn(0x7f078c09b440 0x7f078c0bb8d0 crc :-1 s=READY pgs=90 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 20 client.25473.objecter put_session s=0x7f078c09ad90 osd=7 1 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 20 client.25473.objecter shutdown clearing up homeless session... 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 10 client.25473.objecter successfully canceled tick 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6800/397309233 conn(0x7f078c074100 msgr2=0x7f078c0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 --2- 10.20.193.40:0/3322862004 >> v2:10.20.193.120:6800/397309233 conn(0x7f078c074100 0x7f078c0945b0 secure :-1 s=READY pgs=2257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07c015ec10 tx=0x7f07a8007f90 comp rx=0 tx=0).stop 2026-02-24T17:30:31.610 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f07c00aff60 msgr2=0x7f07c01202b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 --2- 10.20.193.40:0/3322862004 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f07c00aff60 0x7f07c01202b0 secure :-1 s=READY pgs=5211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07b401ca60 tx=0x7f07b4019290 comp rx=0 tx=0).stop 2026-02-24T17:30:31.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07bf577640 1 -- 10.20.193.40:0/3322862004 reap_dead start 2026-02-24T17:30:31.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 shutdown_connections 2026-02-24T17:30:31.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 >> 10.20.193.40:0/3322862004 conn(0x7f07c00b8900 msgr2=0x7f07c00b8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 shutdown_connections 2026-02-24T17:30:31.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 -- 10.20.193.40:0/3322862004 wait complete. 2026-02-24T17:30:31.611 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.607+0000 7f07c4991640 1 librados: shutdown 2026-02-24T17:30:31.618 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-24T17:30:31.680 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5eb1e640 1 Processor -- start 2026-02-24T17:30:31.680 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5eb1e640 1 -- start start 2026-02-24T17:30:31.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5eb1e640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbf5805d1a0 0x7fbf5805d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5eb1e640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fbf580bc470 0x7fbf580b4f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5eb1e640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf581673c0 con 0x7fbf5816ada0 2026-02-24T17:30:31.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5eb1e640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7fbf581676a0 con 0x7fbf5805d1a0 2026-02-24T17:30:31.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5eb1e640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fbf58167980 con 0x7fbf580bc470 2026-02-24T17:30:31.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5c893640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbf5805d1a0 0x7fbf5805d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5c893640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7fbf5805d1a0 0x7fbf5805d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32828/0 (socket says 10.20.193.40:32828) 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5c893640 1 -- 10.20.193.40:0/2107681449 learned_addr learned my addr 10.20.193.40:0/2107681449 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf4ffff640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7fbf5816ada0 0x7fbf58166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:58304/0 (socket says 10.20.193.40:58304) 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.679+0000 7fbf5d094640 1 --2- 10.20.193.40:0/2107681449 >> v2:10.20.193.94:3300/0 conn(0x7fbf580bc470 0x7fbf580b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5c893640 1 -- 10.20.193.40:0/2107681449 >> v2:10.20.193.94:3300/0 conn(0x7fbf580bc470 msgr2=0x7fbf580b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5c893640 1 --2- 10.20.193.40:0/2107681449 >> v2:10.20.193.94:3300/0 conn(0x7fbf580bc470 0x7fbf580b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5c893640 1 -- 10.20.193.40:0/2107681449 >> v1:10.20.193.40:6789/0 conn(0x7fbf5816ada0 legacy=0x7fbf58166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf4f7fe640 1 -- 10.20.193.40:0/2107681449 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538256081 0 0) 0x7fbf581673c0 con 0x7fbf5816ada0 2026-02-24T17:30:31.682 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5c893640 1 -- 10.20.193.40:0/2107681449 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf580b4430 con 0x7fbf5805d1a0 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5c893640 1 --2- 10.20.193.40:0/2107681449 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5805d1a0 0x7fbf5805d570 secure :-1 s=READY pgs=5213 gs=2 cs=0 l=1 c_cookie=17461948545076350027 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf580b70d0 tx=0x7fbf4801c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2554daf336ccc4b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf4f7fe640 1 -- 10.20.193.40:0/2107681449 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf480a6040 con 0x7fbf5805d1a0 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf4f7fe640 1 -- 10.20.193.40:0/2107681449 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf480af070 con 0x7fbf5805d1a0 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf4f7fe640 1 -- 10.20.193.40:0/2107681449 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf480aa8a0 con 0x7fbf5805d1a0 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/2107681449 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5805d1a0 msgr2=0x7fbf5805d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/2107681449 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5805d1a0 0x7fbf5805d570 secure :-1 s=READY pgs=5213 gs=2 cs=0 l=1 c_cookie=17461948545076350027 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf580b70d0 tx=0x7fbf4801c5d0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/2107681449 shutdown_connections 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/2107681449 >> v2:10.20.193.94:3300/0 conn(0x7fbf580bc470 0x7fbf580b4f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/2107681449 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5805d1a0 0x7fbf5805d570 unknown :-1 s=CLOSED pgs=5213 gs=2 cs=0 l=1 c_cookie=17461948545076350027 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/2107681449 >> 10.20.193.40:0/2107681449 conn(0x7fbf580bd200 msgr2=0x7fbf580bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/2107681449 shutdown_connections 2026-02-24T17:30:31.683 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/2107681449 wait complete. 2026-02-24T17:30:31.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 librados: starting msgr at 2026-02-24T17:30:31.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 librados: starting objecter 2026-02-24T17:30:31.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 Processor -- start 2026-02-24T17:30:31.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- start start 2026-02-24T17:30:31.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 librados: setting wanted keys 2026-02-24T17:30:31.684 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 librados: calling monclient init 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf5805d1a0 0x7fbf58161470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf580bc470 0x7fbf58162e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5816ada0 0x7fbf58158450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5815d9e0 con 0x7fbf5816ada0 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5815d860 con 0x7fbf580bc470 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5eb1e640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fbf581cd510 con 0x7fbf5805d1a0 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5d094640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5816ada0 0x7fbf58158450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5d094640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5816ada0 0x7fbf58158450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32838/0 (socket says 10.20.193.40:32838) 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5d094640 1 -- 10.20.193.40:0/95522112 learned_addr learned my addr 10.20.193.40:0/95522112 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf4ffff640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf580bc470 0x7fbf58162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.683+0000 7fbf5c893640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf5805d1a0 0x7fbf58161470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5d094640 1 -- 10.20.193.40:0/95522112 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf5805d1a0 msgr2=0x7fbf58161470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5d094640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf5805d1a0 0x7fbf58161470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5d094640 1 -- 10.20.193.40:0/95522112 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf580bc470 msgr2=0x7fbf58162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5d094640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf580bc470 0x7fbf58162e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5d094640 1 -- 10.20.193.40:0/95522112 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf58163350 con 0x7fbf5816ada0 2026-02-24T17:30:31.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5d094640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5816ada0 0x7fbf58158450 secure :-1 s=READY pgs=5214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf5400ffd0 tx=0x7fbf5400d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 10 client.?.objecter ms_handle_connect 0x7fbf5816ada0 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 1 -- 10.20.193.40:0/95522112 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf54019030 con 0x7fbf5816ada0 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 1 -- 10.20.193.40:0/95522112 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf54015480 con 0x7fbf5816ada0 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 1 -- 10.20.193.40:0/95522112 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf54015850 con 0x7fbf5816ada0 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf58161a90 con 0x7fbf5816ada0 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5eb1e640 10 client.25482.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf58162050 con 0x7fbf5816ada0 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5eb1e640 1 librados: init done 2026-02-24T17:30:31.687 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf581673c0 con 0x7fbf5816ada0 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 1 -- 10.20.193.40:0/95522112 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fbf54026060 con 0x7fbf5816ada0 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 1 --2- 10.20.193.40:0/95522112 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf28074100 0x7fbf280945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 1 -- 10.20.193.40:0/95522112 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fbf5401a070 con 0x7fbf5816ada0 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 10 client.25482.objecter ms_dispatch2 0x7fbf58000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 3 client.25482.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 3 client.25482.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 20 client.25482.objecter dump_active .. 0 homeless 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5c893640 1 --2- 10.20.193.40:0/95522112 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf28074100 0x7fbf280945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 10 client.25482.objecter ms_handle_connect 0x7fbf28074100 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf5c893640 1 --2- 10.20.193.40:0/95522112 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf28074100 0x7fbf280945b0 secure :-1 s=READY pgs=2258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf4801a200 tx=0x7fbf480a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.688 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.687+0000 7fbf4d7fa640 1 -- 10.20.193.40:0/95522112 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7fbf54011040 con 0x7fbf5816ada0 2026-02-24T17:30:31.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.775+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fbf5803b110 con 0x7fbf28074100 2026-02-24T17:30:31.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.775+0000 7fbf4d7fa640 1 -- 10.20.193.40:0/95522112 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbf480af040 con 0x7fbf28074100 2026-02-24T17:30:31.777 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 7 to deep-scrub 2026-02-24T17:30:31.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 10 librados: watch_flush enter 2026-02-24T17:30:31.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 10 librados: watch_flush exit 2026-02-24T17:30:31.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 20 client.25482.objecter shutdown clearing up homeless session... 2026-02-24T17:30:31.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 10 client.25482.objecter successfully canceled tick 2026-02-24T17:30:31.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf28074100 msgr2=0x7fbf280945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/95522112 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf28074100 0x7fbf280945b0 secure :-1 s=READY pgs=2258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf4801a200 tx=0x7fbf480a7000 comp rx=0 tx=0).stop 2026-02-24T17:30:31.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5816ada0 msgr2=0x7fbf58158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5816ada0 0x7fbf58158450 secure :-1 s=READY pgs=5214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf5400ffd0 tx=0x7fbf5400d490 comp rx=0 tx=0).stop 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 shutdown_connections 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/95522112 >> v2:10.20.193.120:6800/397309233 conn(0x7fbf28074100 0x7fbf280945b0 unknown :-1 s=CLOSED pgs=2258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fbf5816ada0 0x7fbf58158450 unknown :-1 s=CLOSED pgs=5214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fbf580bc470 0x7fbf58162e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 --2- 10.20.193.40:0/95522112 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fbf5805d1a0 0x7fbf58161470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 >> 10.20.193.40:0/95522112 conn(0x7fbf580bd200 msgr2=0x7fbf580bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 shutdown_connections 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 -- 10.20.193.40:0/95522112 wait complete. 2026-02-24T17:30:31.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.779+0000 7fbf5eb1e640 1 librados: shutdown 2026-02-24T17:30:31.789 INFO:tasks.ceph:Scrubbing osd.11 2026-02-24T17:30:31.789 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:31.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.851+0000 7fa520617640 1 Processor -- start 2026-02-24T17:30:31.853 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.851+0000 7fa520617640 1 -- start start 2026-02-24T17:30:31.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7fa5181672f0 0x7fa5180b4a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.854 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5180b33a0 con 0x7fa51815a220 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5180b3680 con 0x7fa518159e50 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7fa5180b4570 con 0x7fa5181672f0 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51db8b640 1 --1- >> v1:10.20.193.94:6789/0 conn(0x7fa51815a220 0x7fa518057430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:53442/0 (socket says 10.20.193.40:53442) 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51db8b640 1 -- 10.20.193.40:0/760304442 learned_addr learned my addr 10.20.193.40:0/760304442 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51eb8d640 1 --2- 10.20.193.40:0/760304442 >> v2:10.20.193.94:3300/0 conn(0x7fa5181672f0 0x7fa5180b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51d38a640 1 -- 10.20.193.40:0/760304442 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844774432 0 0) 0x7fa5180b33a0 con 0x7fa51815a220 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51d38a640 1 -- 10.20.193.40:0/760304442 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa500003620 con 0x7fa51815a220 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51eb8d640 1 -- 10.20.193.40:0/760304442 >> v1:10.20.193.109:6789/0 conn(0x7fa518159e50 legacy=0x7fa518166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51eb8d640 1 -- 10.20.193.40:0/760304442 >> v1:10.20.193.94:6789/0 conn(0x7fa51815a220 legacy=0x7fa518057430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.855 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51eb8d640 1 -- 10.20.193.40:0/760304442 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5180b3960 con 0x7fa5181672f0 2026-02-24T17:30:31.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51eb8d640 1 --2- 10.20.193.40:0/760304442 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa5181672f0 0x7fa5180b4a00 secure :-1 s=READY pgs=5199 gs=3 cs=0 l=1 c_cookie=166584661747571762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa514005c90 tx=0x7fa51401d830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24fd3de047e1c32 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51d38a640 1 -- 10.20.193.40:0/760304442 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5140b3070 con 0x7fa5181672f0 2026-02-24T17:30:31.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51d38a640 1 -- 10.20.193.40:0/760304442 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5140a6940 con 0x7fa5181672f0 2026-02-24T17:30:31.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa51d38a640 1 -- 10.20.193.40:0/760304442 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5140a6d50 con 0x7fa5181672f0 2026-02-24T17:30:31.857 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 -- 10.20.193.40:0/760304442 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa5181672f0 msgr2=0x7fa5180b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 --2- 10.20.193.40:0/760304442 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa5181672f0 0x7fa5180b4a00 secure :-1 s=READY pgs=5199 gs=3 cs=0 l=1 c_cookie=166584661747571762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa514005c90 tx=0x7fa51401d830 comp rx=0 tx=0).stop 2026-02-24T17:30:31.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 -- 10.20.193.40:0/760304442 shutdown_connections 2026-02-24T17:30:31.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 --2- 10.20.193.40:0/760304442 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa5181672f0 0x7fa5180b4a00 unknown :-1 s=CLOSED pgs=5199 gs=3 cs=0 l=1 c_cookie=166584661747571762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 -- 10.20.193.40:0/760304442 >> 10.20.193.40:0/760304442 conn(0x7fa5180b58a0 msgr2=0x7fa5180b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 -- 10.20.193.40:0/760304442 shutdown_connections 2026-02-24T17:30:31.858 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.855+0000 7fa520617640 1 -- 10.20.193.40:0/760304442 wait complete. 2026-02-24T17:30:31.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 librados: starting msgr at 2026-02-24T17:30:31.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 librados: starting objecter 2026-02-24T17:30:31.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 Processor -- start 2026-02-24T17:30:31.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 -- start start 2026-02-24T17:30:31.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 librados: setting wanted keys 2026-02-24T17:30:31.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 librados: calling monclient init 2026-02-24T17:30:31.865 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa518159e50 0x7fa5180b0460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa51815a220 0x7fa5180b09a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa5181672f0 0x7fa51811efc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa5180b7650 con 0x7fa51815a220 2026-02-24T17:30:31.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7fa5180b4200 con 0x7fa518159e50 2026-02-24T17:30:31.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7fa5180b77d0 con 0x7fa5181672f0 2026-02-24T17:30:31.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa51815a220 0x7fa5180b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa51815a220 0x7fa5180b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32850/0 (socket says 10.20.193.40:32850) 2026-02-24T17:30:31.866 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 -- 10.20.193.40:0/135886442 learned_addr learned my addr 10.20.193.40:0/135886442 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51e38c640 1 --2- 10.20.193.40:0/135886442 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa518159e50 0x7fa5180b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51eb8d640 1 --2- 10.20.193.40:0/135886442 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa5181672f0 0x7fa51811efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 -- 10.20.193.40:0/135886442 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa5181672f0 msgr2=0x7fa51811efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 --2- 10.20.193.40:0/135886442 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7fa5181672f0 0x7fa51811efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 -- 10.20.193.40:0/135886442 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa518159e50 msgr2=0x7fa5180b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 --2- 10.20.193.40:0/135886442 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7fa518159e50 0x7fa5180b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.867 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 -- 10.20.193.40:0/135886442 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa518139bd0 con 0x7fa51815a220 2026-02-24T17:30:31.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa51db8b640 1 --2- 10.20.193.40:0/135886442 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa51815a220 0x7fa5180b09a0 secure :-1 s=READY pgs=5215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa50c0029e0 tx=0x7fa50c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa4feffd640 10 client.?.objecter ms_handle_connect 0x7fa51815a220 2026-02-24T17:30:31.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa4feffd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:31.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa50c017070 con 0x7fa51815a220 2026-02-24T17:30:31.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c005bf0 con 0x7fa51815a220 2026-02-24T17:30:31.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa518139eb0 con 0x7fa51815a220 2026-02-24T17:30:31.868 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa50c007070 con 0x7fa51815a220 2026-02-24T17:30:31.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 10 client.25485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51813a470 con 0x7fa51815a220 2026-02-24T17:30:31.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 librados: init done 2026-02-24T17:30:31.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 10 client.25485.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:31.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 15 client.25485.objecter _session_command_op_assign -1 1 2026-02-24T17:30:31.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 20 client.25485.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:31.869 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 10 client.25485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5180b4a00 con 0x7fa51815a220 2026-02-24T17:30:31.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7fa50c007210 con 0x7fa51815a220 2026-02-24T17:30:31.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.859+0000 7fa4feffd640 1 --2- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6800/397309233 conn(0x7fa4e8074080 0x7fa4e8094530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7fa50c096490 con 0x7fa51815a220 2026-02-24T17:30:31.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 10 client.25485.objecter ms_dispatch2 0x7fa518000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:31.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 3 client.25485.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:31.870 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 3 client.25485.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:31.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa51e38c640 1 --2- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6800/397309233 conn(0x7fa4e8074080 0x7fa4e8094530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 10 client.25485.objecter checking command 1 2026-02-24T17:30:31.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 1 --2- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6801/50161754 conn(0x7fa4e809b420 0x7fa4e80bb8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 20 client.25485.objecter _get_session s=0x7fa4e809ad70 osd=11 3 2026-02-24T17:30:31.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 20 client.25485.objecter put_session s=0x7fa4e809ad70 osd=11 3 2026-02-24T17:30:31.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 15 client.25485.objecter _session_command_op_remove -1 1 2026-02-24T17:30:31.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 20 client.25485.objecter _get_session s=0x7fa4e809ad70 osd=11 3 2026-02-24T17:30:31.871 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 20 client.25485.objecter get_session s=0x7fa4e809ad70 osd=11 3 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 15 client.25485.objecter _session_command_op_assign 11 1 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 20 client.25485.objecter put_session s=0x7fa4e809ad70 osd=11 4 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 10 client.25485.objecter _send_command 1 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 --> v2:10.20.193.120:6801/50161754 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4e80bbf40 con 0x7fa4e809b420 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 20 client.25485.objecter dump_active .. 0 homeless 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fa50c0968f0 con 0x7fa51815a220 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa51eb8d640 1 --2- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6801/50161754 conn(0x7fa4e809b420 0x7fa4e80bb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa51e38c640 1 --2- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6800/397309233 conn(0x7fa4e8074080 0x7fa4e8094530 secure :-1 s=READY pgs=2259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa508002810 tx=0x7fa508009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.872 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 10 client.25485.objecter ms_handle_connect 0x7fa4e8074080 2026-02-24T17:30:31.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 10 client.25485.objecter ms_handle_connect 0x7fa4e809b420 2026-02-24T17:30:31.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa51eb8d640 1 --2- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6801/50161754 conn(0x7fa4e809b420 0x7fa4e80bb8b0 crc :-1 s=READY pgs=77 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 <== osd.11 v2:10.20.193.120:6801/50161754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fa4e80bbf40 con 0x7fa4e809b420 2026-02-24T17:30:31.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 10 client.25485.objecter ms_dispatch2 0x7fa518000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:31.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 10 client.25485.objecter _finish_command 1 = system:0 2026-02-24T17:30:31.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 20 client.25485.objecter put_session s=0x7fa4e809ad70 osd=11 4 2026-02-24T17:30:31.873 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.863+0000 7fa4feffd640 15 client.25485.objecter _session_command_op_remove 11 1 2026-02-24T17:30:31.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 10 client.25485.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:31.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 15 client.25485.objecter _session_command_op_assign -1 2 2026-02-24T17:30:31.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 20 client.25485.objecter _get_session s=0x7fa4e809ad70 osd=11 3 2026-02-24T17:30:31.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 20 client.25485.objecter put_session s=0x7fa4e809ad70 osd=11 3 2026-02-24T17:30:31.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 20 client.25485.objecter _get_session s=0x7fa4e809ad70 osd=11 3 2026-02-24T17:30:31.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 15 client.25485.objecter _session_command_op_remove -1 2 2026-02-24T17:30:31.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 20 client.25485.objecter get_session s=0x7fa4e809ad70 osd=11 3 2026-02-24T17:30:31.875 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 15 client.25485.objecter _session_command_op_assign 11 2 2026-02-24T17:30:31.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 20 client.25485.objecter put_session s=0x7fa4e809ad70 osd=11 4 2026-02-24T17:30:31.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 10 client.25485.objecter _send_command 2 2026-02-24T17:30:31.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 --> v2:10.20.193.120:6801/50161754 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa518164590 con 0x7fa4e809b420 2026-02-24T17:30:31.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa4feffd640 1 -- 10.20.193.40:0/135886442 <== osd.11 v2:10.20.193.120:6801/50161754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa518164590 con 0x7fa4e809b420 2026-02-24T17:30:31.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa4feffd640 10 client.25485.objecter ms_dispatch2 0x7fa518000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:31.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa4feffd640 10 client.25485.objecter _finish_command 2 = system:0 2026-02-24T17:30:31.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa4feffd640 20 client.25485.objecter put_session s=0x7fa4e809ad70 osd=11 4 2026-02-24T17:30:31.876 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa4feffd640 15 client.25485.objecter _session_command_op_remove 11 2 2026-02-24T17:30:31.877 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:31.877 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:31.877 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:31.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 10 librados: watch_flush enter 2026-02-24T17:30:31.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 10 librados: watch_flush exit 2026-02-24T17:30:31.879 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 10 client.25485.objecter close_session for osd.11 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6801/50161754 conn(0x7fa4e809b420 msgr2=0x7fa4e80bb8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 --2- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6801/50161754 conn(0x7fa4e809b420 0x7fa4e80bb8b0 crc :-1 s=READY pgs=77 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 20 client.25485.objecter put_session s=0x7fa4e809ad70 osd=11 1 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 20 client.25485.objecter shutdown clearing up homeless session... 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 10 client.25485.objecter successfully canceled tick 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6800/397309233 conn(0x7fa4e8074080 msgr2=0x7fa4e8094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 --2- 10.20.193.40:0/135886442 >> v2:10.20.193.120:6800/397309233 conn(0x7fa4e8074080 0x7fa4e8094530 secure :-1 s=READY pgs=2259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa508002810 tx=0x7fa508009040 comp rx=0 tx=0).stop 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa51815a220 msgr2=0x7fa5180b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 --2- 10.20.193.40:0/135886442 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7fa51815a220 0x7fa5180b09a0 secure :-1 s=READY pgs=5215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa50c0029e0 tx=0x7fa50c00cb90 comp rx=0 tx=0).stop 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa51eb8d640 1 -- 10.20.193.40:0/135886442 reap_dead start 2026-02-24T17:30:31.880 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 shutdown_connections 2026-02-24T17:30:31.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 >> 10.20.193.40:0/135886442 conn(0x7fa5180b58a0 msgr2=0x7fa518166b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 shutdown_connections 2026-02-24T17:30:31.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 -- 10.20.193.40:0/135886442 wait complete. 2026-02-24T17:30:31.881 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.871+0000 7fa520617640 1 librados: shutdown 2026-02-24T17:30:31.881 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-24T17:30:31.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.951+0000 7f6acbda8640 1 Processor -- start 2026-02-24T17:30:31.952 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.951+0000 7f6acbda8640 1 -- start start 2026-02-24T17:30:31.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f6ac40b28d0 0x7f6ac40b3cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac416aed0 con 0x7f6ac40b41f0 2026-02-24T17:30:31.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac4166de0 con 0x7f6ac40b2500 2026-02-24T17:30:31.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac4166bb0 con 0x7f6ac40b28d0 2026-02-24T17:30:31.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac931c640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f6ac40b28d0 0x7f6ac40b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac9b1d640 1 --1- >> v1:10.20.193.109:6789/0 conn(0x7f6ac40b2500 0x7f6ac40b3560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.109:6789/0 says I am v1:10.20.193.40:58894/0 (socket says 10.20.193.40:58894) 2026-02-24T17:30:31.953 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac9b1d640 1 -- 10.20.193.40:0/2631684843 learned_addr learned my addr 10.20.193.40:0/2631684843 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:31.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6aca31e640 1 --1- 10.20.193.40:0/2631684843 >> v1:10.20.193.94:6789/0 conn(0x7f6ac40b41f0 0x7f6ac41607f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.94:6789/0 says I am v1:10.20.193.40:53444/0 (socket says 10.20.193.40:53444) 2026-02-24T17:30:31.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac9b1d640 1 -- 10.20.193.40:0/2631684843 >> v1:10.20.193.109:6789/0 conn(0x7f6ac40b2500 legacy=0x7f6ac40b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-24T17:30:31.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac9b1d640 1 -- 10.20.193.40:0/2631684843 >> v1:10.20.193.109:6789/0 conn(0x7f6ac40b2500 legacy=0x7f6ac40b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:30:31.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac9b1d640 1 --1- 10.20.193.40:0/2631684843 >> v1:10.20.193.109:6789/0 conn(0x7f6ac40b2500 0x7f6ac40b3560 :-1 s=OPENED pgs=5488 gs=1 cs=1 l=1).handle_message read tag failed 2026-02-24T17:30:31.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac9b1d640 1 --1- 10.20.193.40:0/2631684843 >> v1:10.20.193.109:6789/0 conn(0x7f6ac40b2500 0x7f6ac40b3560 :-1 s=OPENED pgs=5488 gs=1 cs=1 l=1).fault on lossy channel, failing 2026-02-24T17:30:31.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac931c640 1 -- 10.20.193.40:0/2631684843 >> v1:10.20.193.109:6789/0 conn(0x7f6ac40b2500 legacy=0x7f6ac40b3560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-24T17:30:31.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac931c640 1 -- 10.20.193.40:0/2631684843 >> v1:10.20.193.94:6789/0 conn(0x7f6ac40b41f0 legacy=0x7f6ac41607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.954 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac931c640 1 -- 10.20.193.40:0/2631684843 --> v2:10.20.193.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac41670c0 con 0x7f6ac40b28d0 2026-02-24T17:30:31.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac931c640 1 --2- 10.20.193.40:0/2631684843 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 0x7f6ac40b3cb0 secure :-1 s=READY pgs=5201 gs=3 cs=0 l=1 c_cookie=12462449856553813919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ac40b8880 tx=0x7f6ab801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf3841d9b02079f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac8b1b640 1 -- 10.20.193.40:0/2631684843 <== mon.1 v2:10.20.193.94:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ab80b0070 con 0x7f6ac40b28d0 2026-02-24T17:30:31.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac8b1b640 1 -- 10.20.193.40:0/2631684843 <== mon.1 v2:10.20.193.94:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab80ab620 con 0x7f6ac40b28d0 2026-02-24T17:30:31.955 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6ac8b1b640 1 -- 10.20.193.40:0/2631684843 <== mon.1 v2:10.20.193.94:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ab80aba10 con 0x7f6ac40b28d0 2026-02-24T17:30:31.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 -- 10.20.193.40:0/2631684843 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 msgr2=0x7f6ac40b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 --2- 10.20.193.40:0/2631684843 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 0x7f6ac40b3cb0 secure :-1 s=READY pgs=5201 gs=3 cs=0 l=1 c_cookie=12462449856553813919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ac40b8880 tx=0x7f6ab801c410 comp rx=0 tx=0).stop 2026-02-24T17:30:31.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 -- 10.20.193.40:0/2631684843 shutdown_connections 2026-02-24T17:30:31.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 --2- 10.20.193.40:0/2631684843 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 0x7f6ac40b3cb0 unknown :-1 s=CLOSED pgs=5201 gs=3 cs=0 l=1 c_cookie=12462449856553813919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 -- 10.20.193.40:0/2631684843 >> 10.20.193.40:0/2631684843 conn(0x7f6ac40b8fd0 msgr2=0x7f6ac40b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:31.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 -- 10.20.193.40:0/2631684843 shutdown_connections 2026-02-24T17:30:31.956 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.955+0000 7f6acbda8640 1 -- 10.20.193.40:0/2631684843 wait complete. 2026-02-24T17:30:31.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 librados: starting msgr at 2026-02-24T17:30:31.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 librados: starting objecter 2026-02-24T17:30:31.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 Processor -- start 2026-02-24T17:30:31.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 -- start start 2026-02-24T17:30:31.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 librados: setting wanted keys 2026-02-24T17:30:31.957 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 librados: calling monclient init 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac40b2500 0x7f6ac40b4850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 0x7f6ac4140e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ac40b41f0 0x7f6ac4141390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4167710 con 0x7f6ac40b2500 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac416ab50 con 0x7f6ac40b28d0 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac41ce4e0 con 0x7f6ac40b41f0 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac40b2500 0x7f6ac40b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac40b2500 0x7f6ac40b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32854/0 (socket says 10.20.193.40:32854) 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 -- 10.20.193.40:0/3625766616 learned_addr learned my addr 10.20.193.40:0/3625766616 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6aca31e640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ac40b41f0 0x7f6ac4141390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.958 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac931c640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 0x7f6ac4140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 -- 10.20.193.40:0/3625766616 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ac40b41f0 msgr2=0x7f6ac4141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ac40b41f0 0x7f6ac4141390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 -- 10.20.193.40:0/3625766616 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 msgr2=0x7f6ac4140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 0x7f6ac4140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 -- 10.20.193.40:0/3625766616 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac4138210 con 0x7f6ac40b2500 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac9b1d640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac40b2500 0x7f6ac40b4850 secure :-1 s=READY pgs=5216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab400c7b0 tx=0x7f6ab400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 10 client.?.objecter ms_handle_connect 0x7f6ac40b2500 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 1 -- 10.20.193.40:0/3625766616 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ab4017070 con 0x7f6ac40b2500 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 1 -- 10.20.193.40:0/3625766616 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab4005bf0 con 0x7f6ac40b2500 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac41384f0 con 0x7f6ac40b2500 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 1 -- 10.20.193.40:0/3625766616 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ab4007070 con 0x7f6ac40b2500 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 10 client.25488.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac4138ab0 con 0x7f6ac40b2500 2026-02-24T17:30:31.959 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 librados: init done 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac40b3cb0 con 0x7f6ac40b2500 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 1 -- 10.20.193.40:0/3625766616 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f6ab4007210 con 0x7f6ac40b2500 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 1 --2- 10.20.193.40:0/3625766616 >> v2:10.20.193.120:6800/397309233 conn(0x7f6a94074080 0x7f6a94094530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 1 -- 10.20.193.40:0/3625766616 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f6ab40960c0 con 0x7f6ac40b2500 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 10 client.25488.objecter ms_dispatch2 0x7f6ac4000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 3 client.25488.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 3 client.25488.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ab27fc640 20 client.25488.objecter dump_active .. 0 homeless 2026-02-24T17:30:31.960 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.959+0000 7f6ac931c640 1 --2- 10.20.193.40:0/3625766616 >> v2:10.20.193.120:6800/397309233 conn(0x7f6a94074080 0x7f6a94094530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:31.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.963+0000 7f6ac931c640 1 --2- 10.20.193.40:0/3625766616 >> v2:10.20.193.120:6800/397309233 conn(0x7f6a94074080 0x7f6a94094530 secure :-1 s=READY pgs=2260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab8002410 tx=0x7f6ab8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:31.961 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.963+0000 7f6ab27fc640 10 client.25488.objecter ms_handle_connect 0x7f6a94074080 2026-02-24T17:30:31.962 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:31.963+0000 7f6ab27fc640 1 -- 10.20.193.40:0/3625766616 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f6ab4021070 con 0x7f6ac40b2500 2026-02-24T17:30:32.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f6ac40afc50 con 0x7f6a94074080 2026-02-24T17:30:32.049 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6ab27fc640 1 -- 10.20.193.40:0/3625766616 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f6ac40afc50 con 0x7f6a94074080 2026-02-24T17:30:32.049 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 11 to deep-scrub 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 10 librados: watch_flush enter 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 10 librados: watch_flush exit 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 20 client.25488.objecter shutdown clearing up homeless session... 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 10 client.25488.objecter successfully canceled tick 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 >> v2:10.20.193.120:6800/397309233 conn(0x7f6a94074080 msgr2=0x7f6a94094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 --2- 10.20.193.40:0/3625766616 >> v2:10.20.193.120:6800/397309233 conn(0x7f6a94074080 0x7f6a94094530 secure :-1 s=READY pgs=2260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab8002410 tx=0x7f6ab8008040 comp rx=0 tx=0).stop 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac40b2500 msgr2=0x7f6ac40b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac40b2500 0x7f6ac40b4850 secure :-1 s=READY pgs=5216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ab400c7b0 tx=0x7f6ab400cc70 comp rx=0 tx=0).stop 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 shutdown_connections 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 --2- 10.20.193.40:0/3625766616 >> v2:10.20.193.120:6800/397309233 conn(0x7f6a94074080 0x7f6a94094530 unknown :-1 s=CLOSED pgs=2260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f6ac40b41f0 0x7f6ac4141390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f6ac40b28d0 0x7f6ac4140e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 --2- 10.20.193.40:0/3625766616 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f6ac40b2500 0x7f6ac40b4850 unknown :-1 s=CLOSED pgs=5216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 >> 10.20.193.40:0/3625766616 conn(0x7f6ac40b8fd0 msgr2=0x7f6ac41605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 shutdown_connections 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 -- 10.20.193.40:0/3625766616 wait complete. 2026-02-24T17:30:32.050 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.051+0000 7f6acbda8640 1 librados: shutdown 2026-02-24T17:30:32.061 INFO:tasks.ceph:Scrubbing osd.15 2026-02-24T17:30:32.061 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-24T17:30:32.133 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 Processor -- start 2026-02-24T17:30:32.134 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- start start 2026-02-24T17:30:32.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200b33a0 con 0x7f2a201672f0 2026-02-24T17:30:32.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200b3680 con 0x7f2a20159e50 2026-02-24T17:30:32.140 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a200b3960 con 0x7f2a2015a220 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f2a201672f0 0x7f2a20057b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:58308/0 (socket says 10.20.193.40:58308) 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 -- 10.20.193.40:0/2440991377 learned_addr learned my addr 10.20.193.40:0/2440991377 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530012141 0 0) 0x7f2a200b33a0 con 0x7f2a201672f0 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a0c0058b0 con 0x7f2a201672f0 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964818716 0 0) 0x7f2a200b3680 con 0x7f2a20159e50 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a200b33a0 con 0x7f2a20159e50 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2072510972 0 0) 0x7f2a0c0058b0 con 0x7f2a201672f0 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 >> v1:10.20.193.109:6789/0 conn(0x7f2a2015a220 legacy=0x7f2a20057430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 >> v1:10.20.193.94:6789/0 conn(0x7f2a20159e50 legacy=0x7f2a20166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a200b3c40 con 0x7f2a201672f0 2026-02-24T17:30:32.141 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7f2a1c004310 con 0x7f2a201672f0 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 >> v1:10.20.193.40:6789/0 conn(0x7f2a201672f0 legacy=0x7f2a20057b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2a0c006010 0x7f2a0c0063e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2a0c006b60 0x7f2a0c006fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a0c047d10 0x7f2a0c0680f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c068680 con 0x7f2a0c047d10 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c068830 con 0x7f2a0c006010 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c068a30 con 0x7f2a0c006b60 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a0c047d10 0x7f2a0c0680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a17fff640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2a0c006b60 0x7f2a0c006fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a249fd640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2a0c006010 0x7f2a0c0063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.142 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 -- 10.20.193.40:0/2440991377 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2a0c006b60 msgr2=0x7f2a0c006fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2a0c006b60 0x7f2a0c006fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 -- 10.20.193.40:0/2440991377 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2a0c006010 msgr2=0x7f2a0c0063e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2a0c006010 0x7f2a0c0063e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 -- 10.20.193.40:0/2440991377 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c0058b0 con 0x7f2a0c047d10 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 -- 10.20.193.40:0/2440991377 reap_dead start 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a251fe640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a0c047d10 0x7f2a0c0680f0 secure :-1 s=READY pgs=5218 gs=4 cs=0 l=1 c_cookie=11187428173698929261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c00b640 tx=0x7f2a1c01e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b41baa68385926d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c00b290 con 0x7f2a0c047d10 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1c0ad680 con 0x7f2a0c047d10 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a177fe640 1 -- 10.20.193.40:0/2440991377 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c0ada90 con 0x7f2a0c047d10 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- 10.20.193.40:0/2440991377 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a0c047d10 msgr2=0x7f2a0c0680f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a0c047d10 0x7f2a0c0680f0 secure :-1 s=READY pgs=5218 gs=4 cs=0 l=1 c_cookie=11187428173698929261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c00b640 tx=0x7f2a1c01e120 comp rx=0 tx=0).stop 2026-02-24T17:30:32.143 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- 10.20.193.40:0/2440991377 shutdown_connections 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 --2- 10.20.193.40:0/2440991377 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a0c047d10 0x7f2a0c0680f0 unknown :-1 s=CLOSED pgs=5218 gs=4 cs=0 l=1 c_cookie=11187428173698929261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- 10.20.193.40:0/2440991377 >> 10.20.193.40:0/2440991377 conn(0x7f2a200b58a0 msgr2=0x7f2a200b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- 10.20.193.40:0/2440991377 shutdown_connections 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.135+0000 7f2a26c88640 1 -- 10.20.193.40:0/2440991377 wait complete. 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 librados: starting msgr at 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 librados: starting objecter 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 Processor -- start 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 -- start start 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 librados: setting wanted keys 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 librados: calling monclient init 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2a0c047d10 0x7f2a20136340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.144 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a20136880 0x7f2a2015ff00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2a20160440 0x7f2a20201b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2a200b4200 con 0x7f2a20136880 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2a200b4570 con 0x7f2a0c047d10 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2a200b49e0 con 0x7f2a20160440 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a20136880 0x7f2a2015ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a20136880 0x7f2a2015ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32872/0 (socket says 10.20.193.40:32872) 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 -- 10.20.193.40:0/2823744103 learned_addr learned my addr 10.20.193.40:0/2823744103 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a249fd640 1 --2- 10.20.193.40:0/2823744103 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2a0c047d10 0x7f2a20136340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a251fe640 1 --2- 10.20.193.40:0/2823744103 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2a20160440 0x7f2a20201b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 -- 10.20.193.40:0/2823744103 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2a20160440 msgr2=0x7f2a20201b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 --2- 10.20.193.40:0/2823744103 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2a20160440 0x7f2a20201b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.145 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 -- 10.20.193.40:0/2823744103 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2a0c047d10 msgr2=0x7f2a20136340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 --2- 10.20.193.40:0/2823744103 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2a0c047d10 0x7f2a20136340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 -- 10.20.193.40:0/2823744103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a20200e10 con 0x7f2a20136880 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a157fa640 10 client.?.objecter ms_handle_connect 0x7f2a20136880 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a157fa640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a17fff640 1 --2- 10.20.193.40:0/2823744103 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a20136880 0x7f2a2015ff00 secure :-1 s=READY pgs=5219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a08005680 tx=0x7f2a08010670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a08010e40 con 0x7f2a20136880 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08019070 con 0x7f2a20136880 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a08004310 con 0x7f2a20136880 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a202010f0 con 0x7f2a20136880 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 10 client.25494.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a202016b0 con 0x7f2a20136880 2026-02-24T17:30:32.146 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 librados: init done 2026-02-24T17:30:32.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 10 client.25494.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T17:30:32.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 15 client.25494.objecter _session_command_op_assign -1 1 2026-02-24T17:30:32.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 20 client.25494.objecter _get_session osd=-1 returning homeless 2026-02-24T17:30:32.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 10 client.25494.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:32.147 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a201fe930 con 0x7f2a20136880 2026-02-24T17:30:32.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.139+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f2a080044b0 con 0x7f2a20136880 2026-02-24T17:30:32.149 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 1 --2- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6800/397309233 conn(0x7f29f0074090 0x7f29f0094540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f2a08099800 con 0x7f2a20136880 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 10 client.25494.objecter ms_dispatch2 0x7f2a20000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 3 client.25494.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 3 client.25494.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 10 client.25494.objecter checking command 1 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 1 --2- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6805/2868608910 conn(0x7f29f009b3d0 0x7f29f00bb860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 20 client.25494.objecter _get_session s=0x7f29f009ad20 osd=15 3 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 20 client.25494.objecter put_session s=0x7f29f009ad20 osd=15 3 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 15 client.25494.objecter _session_command_op_remove -1 1 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 20 client.25494.objecter _get_session s=0x7f29f009ad20 osd=15 3 2026-02-24T17:30:32.150 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 20 client.25494.objecter get_session s=0x7f29f009ad20 osd=15 3 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 15 client.25494.objecter _session_command_op_assign 15 1 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 20 client.25494.objecter put_session s=0x7f29f009ad20 osd=15 4 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 10 client.25494.objecter _send_command 1 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 --> v2:10.20.193.120:6805/2868608910 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a08020e70 con 0x7f29f009b3d0 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 20 client.25494.objecter dump_active .. 0 homeless 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7f2a08099bf0 con 0x7f2a20136880 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a249fd640 1 --2- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6800/397309233 conn(0x7f29f0074090 0x7f29f0094540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a251fe640 1 --2- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6805/2868608910 conn(0x7f29f009b3d0 0x7f29f00bb860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 10 client.25494.objecter ms_handle_connect 0x7f29f0074090 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a249fd640 1 --2- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6800/397309233 conn(0x7f29f0074090 0x7f29f0094540 secure :-1 s=READY pgs=2261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a10007980 tx=0x7f2a10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 10 client.25494.objecter ms_handle_connect 0x7f29f009b3d0 2026-02-24T17:30:32.151 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a251fe640 1 --2- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6805/2868608910 conn(0x7f29f009b3d0 0x7f29f00bb860 crc :-1 s=READY pgs=73 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 <== osd.15 v2:10.20.193.120:6805/2868608910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f2a08020e70 con 0x7f29f009b3d0 2026-02-24T17:30:32.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 10 client.25494.objecter ms_dispatch2 0x7f2a20000ba0 command_reply(tid 1: 0 ) 2026-02-24T17:30:32.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 10 client.25494.objecter _finish_command 1 = system:0 2026-02-24T17:30:32.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 20 client.25494.objecter put_session s=0x7f29f009ad20 osd=15 4 2026-02-24T17:30:32.152 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.143+0000 7f2a157fa640 15 client.25494.objecter _session_command_op_remove 15 1 2026-02-24T17:30:32.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 10 client.25494.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T17:30:32.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 15 client.25494.objecter _session_command_op_assign -1 2 2026-02-24T17:30:32.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 20 client.25494.objecter _get_session s=0x7f29f009ad20 osd=15 3 2026-02-24T17:30:32.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 20 client.25494.objecter put_session s=0x7f29f009ad20 osd=15 3 2026-02-24T17:30:32.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 20 client.25494.objecter _get_session s=0x7f29f009ad20 osd=15 3 2026-02-24T17:30:32.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 15 client.25494.objecter _session_command_op_remove -1 2 2026-02-24T17:30:32.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 20 client.25494.objecter get_session s=0x7f29f009ad20 osd=15 3 2026-02-24T17:30:32.153 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 15 client.25494.objecter _session_command_op_assign 15 2 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 20 client.25494.objecter put_session s=0x7f29f009ad20 osd=15 4 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 10 client.25494.objecter _send_command 2 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 --> v2:10.20.193.120:6805/2868608910 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2a201fc4e0 con 0x7f29f009b3d0 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a157fa640 1 -- 10.20.193.40:0/2823744103 <== osd.15 v2:10.20.193.120:6805/2868608910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2a201fc4e0 con 0x7f29f009b3d0 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a157fa640 10 client.25494.objecter ms_dispatch2 0x7f2a20000ba0 command_reply(tid 2: 0 ) 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a157fa640 10 client.25494.objecter _finish_command 2 = system:0 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a157fa640 20 client.25494.objecter put_session s=0x7f29f009ad20 osd=15 4 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a157fa640 15 client.25494.objecter _session_command_op_remove 15 2 2026-02-24T17:30:32.154 INFO:teuthology.orchestra.run.trial040.stdout:{ 2026-02-24T17:30:32.155 INFO:teuthology.orchestra.run.trial040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T17:30:32.155 INFO:teuthology.orchestra.run.trial040.stdout:} 2026-02-24T17:30:32.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 10 librados: watch_flush enter 2026-02-24T17:30:32.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 10 librados: watch_flush exit 2026-02-24T17:30:32.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 10 client.25494.objecter close_session for osd.15 2026-02-24T17:30:32.156 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6805/2868608910 conn(0x7f29f009b3d0 msgr2=0x7f29f00bb860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 --2- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6805/2868608910 conn(0x7f29f009b3d0 0x7f29f00bb860 crc :-1 s=READY pgs=73 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 20 client.25494.objecter put_session s=0x7f29f009ad20 osd=15 1 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 20 client.25494.objecter shutdown clearing up homeless session... 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 10 client.25494.objecter successfully canceled tick 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6800/397309233 conn(0x7f29f0074090 msgr2=0x7f29f0094540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 --2- 10.20.193.40:0/2823744103 >> v2:10.20.193.120:6800/397309233 conn(0x7f29f0074090 0x7f29f0094540 secure :-1 s=READY pgs=2261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a10007980 tx=0x7f2a10009040 comp rx=0 tx=0).stop 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a20136880 msgr2=0x7f2a2015ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 --2- 10.20.193.40:0/2823744103 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2a20136880 0x7f2a2015ff00 secure :-1 s=READY pgs=5219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a08005680 tx=0x7f2a08010670 comp rx=0 tx=0).stop 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a251fe640 1 -- 10.20.193.40:0/2823744103 reap_dead start 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 shutdown_connections 2026-02-24T17:30:32.157 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 >> 10.20.193.40:0/2823744103 conn(0x7f2a200b58a0 msgr2=0x7f2a2005bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:32.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 shutdown_connections 2026-02-24T17:30:32.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 -- 10.20.193.40:0/2823744103 wait complete. 2026-02-24T17:30:32.158 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.151+0000 7f2a26c88640 1 librados: shutdown 2026-02-24T17:30:32.160 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-24T17:30:32.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff86c862640 1 Processor -- start 2026-02-24T17:30:32.222 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff86c862640 1 -- start start 2026-02-24T17:30:32.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff86c862640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7ff868167350 0x7ff8680b42c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.227 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff86c862640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff868056e00 con 0x7ff868164b40 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff86c862640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8680570e0 con 0x7ff86815a010 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff86c862640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7ff8680573c0 con 0x7ff868167350 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865d74640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7ff868164b40 0x7ff868166c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:58318/0 (socket says 10.20.193.40:58318) 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865d74640 1 -- 10.20.193.40:0/3393859673 learned_addr learned my addr 10.20.193.40:0/3393859673 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff866d76640 1 --2- 10.20.193.40:0/3393859673 >> v2:10.20.193.94:3300/0 conn(0x7ff868167350 0x7ff8680b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224012113 0 0) 0x7ff868056e00 con 0x7ff868164b40 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 --> v1:10.20.193.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff854003620 con 0x7ff868164b40 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 <== mon.1 v1:10.20.193.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290537255 0 0) 0x7ff8680570e0 con 0x7ff86815a010 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 --> v1:10.20.193.94:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff868056e00 con 0x7ff86815a010 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 <== mon.0 v1:10.20.193.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1842630655 0 0) 0x7ff854003620 con 0x7ff868164b40 2026-02-24T17:30:32.228 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 >> v2:10.20.193.94:3300/0 conn(0x7ff868167350 msgr2=0x7ff8680b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 --2- 10.20.193.40:0/3393859673 >> v2:10.20.193.94:3300/0 conn(0x7ff868167350 0x7ff8680b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 >> v1:10.20.193.94:6789/0 conn(0x7ff86815a010 legacy=0x7ff8680565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 --> v1:10.20.193.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8680576a0 con 0x7ff868164b40 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 <== mon.0 v1:10.20.193.40:6789/0 3 ==== mon_map magic: 0 ==== 437+0+0 (unknown 708723415 0 0) 0x7ff850002e80 con 0x7ff868164b40 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 >> v1:10.20.193.40:6789/0 conn(0x7ff868164b40 legacy=0x7ff868166c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff854003dd0 0x7ff8540041c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff8540048d0 0x7ff854004d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff854005450 0x7ff854065a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff8680573c0 con 0x7ff8540048d0 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff854066320 con 0x7ff854005450 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff854066520 con 0x7ff854003dd0 2026-02-24T17:30:32.229 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865d74640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff8540048d0 0x7ff854004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff866575640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff854003dd0 0x7ff8540041c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff866d76640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff854005450 0x7ff854065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865d74640 1 -- 10.20.193.40:0/3393859673 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff854003dd0 msgr2=0x7ff8540041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865d74640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff854003dd0 0x7ff8540041c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865d74640 1 -- 10.20.193.40:0/3393859673 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff854005450 msgr2=0x7ff854065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865d74640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff854005450 0x7ff854065a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff865d74640 1 -- 10.20.193.40:0/3393859673 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff854003620 con 0x7ff8540048d0 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff866d76640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff854005450 0x7ff854065a90 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.223+0000 7ff866d76640 1 -- 10.20.193.40:0/3393859673 reap_dead start 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff8540048d0 0x7ff854004d40 secure :-1 s=READY pgs=5221 gs=4 cs=0 l=1 c_cookie=1809025214366849313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8500036c0 tx=0x7ff85001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191af2d90c0f9921 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.230 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff850007d40 con 0x7ff8540048d0 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8500a9020 con 0x7ff8540048d0 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865573640 1 -- 10.20.193.40:0/3393859673 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8500a5970 con 0x7ff8540048d0 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- 10.20.193.40:0/3393859673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff8540048d0 msgr2=0x7ff854004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff8540048d0 0x7ff854004d40 secure :-1 s=READY pgs=5221 gs=4 cs=0 l=1 c_cookie=1809025214366849313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8500036c0 tx=0x7ff85001cbf0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- 10.20.193.40:0/3393859673 shutdown_connections 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 --2- 10.20.193.40:0/3393859673 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff8540048d0 0x7ff854004d40 unknown :-1 s=CLOSED pgs=5221 gs=4 cs=0 l=1 c_cookie=1809025214366849313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- 10.20.193.40:0/3393859673 >> 10.20.193.40:0/3393859673 conn(0x7ff8680b8fd0 msgr2=0x7ff8680b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- 10.20.193.40:0/3393859673 shutdown_connections 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- 10.20.193.40:0/3393859673 wait complete. 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 librados: starting msgr at 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 librados: starting objecter 2026-02-24T17:30:32.231 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 Processor -- start 2026-02-24T17:30:32.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- start start 2026-02-24T17:30:32.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 librados: setting wanted keys 2026-02-24T17:30:32.232 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 librados: calling monclient init 2026-02-24T17:30:32.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff8540048d0 0x7ff868147c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff86813d5d0 0x7ff86805d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff86805d6f0 0x7ff868134220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff868056b80 con 0x7ff86813d5d0 2026-02-24T17:30:32.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7ff868056a00 con 0x7ff8540048d0 2026-02-24T17:30:32.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7ff86815a3e0 con 0x7ff86805d6f0 2026-02-24T17:30:32.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff86813d5d0 0x7ff86805d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.235 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff86813d5d0 0x7ff86805d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32886/0 (socket says 10.20.193.40:32886) 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 -- 10.20.193.40:0/1362860221 learned_addr learned my addr 10.20.193.40:0/1362860221 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff866d76640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff86805d6f0 0x7ff868134220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff866575640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff8540048d0 0x7ff868147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 -- 10.20.193.40:0/1362860221 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff86805d6f0 msgr2=0x7ff868134220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff86805d6f0 0x7ff868134220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 -- 10.20.193.40:0/1362860221 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff8540048d0 msgr2=0x7ff868147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff8540048d0 0x7ff868147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 -- 10.20.193.40:0/1362860221 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff868161430 con 0x7ff86813d5d0 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff865d74640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff86813d5d0 0x7ff86805d1b0 secure :-1 s=READY pgs=5222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff850007c10 tx=0x7ff854005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff84effd640 10 client.?.objecter ms_handle_connect 0x7ff86813d5d0 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff84effd640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:32.236 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff84effd640 1 -- 10.20.193.40:0/1362860221 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff850003490 con 0x7ff86813d5d0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff84effd640 1 -- 10.20.193.40:0/1362860221 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8500a5970 con 0x7ff86813d5d0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff84effd640 1 -- 10.20.193.40:0/1362860221 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8500a5d80 con 0x7ff86813d5d0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff868161710 con 0x7ff86813d5d0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 10 client.25500.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff868161cd0 con 0x7ff86813d5d0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 librados: init done 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.227+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff868058180 con 0x7ff86813d5d0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 1 -- 10.20.193.40:0/1362860221 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7ff8500b6020 con 0x7ff86813d5d0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 1 --2- 10.20.193.40:0/1362860221 >> v2:10.20.193.120:6800/397309233 conn(0x7ff8340740f0 0x7ff8340945a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 1 -- 10.20.193.40:0/1362860221 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7ff8500aa030 con 0x7ff86813d5d0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 10 client.25500.objecter ms_dispatch2 0x7ff868000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 3 client.25500.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:32.237 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 3 client.25500.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:32.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff866575640 1 --2- 10.20.193.40:0/1362860221 >> v2:10.20.193.120:6800/397309233 conn(0x7ff8340740f0 0x7ff8340945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 20 client.25500.objecter dump_active .. 0 homeless 2026-02-24T17:30:32.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 10 client.25500.objecter ms_handle_connect 0x7ff8340740f0 2026-02-24T17:30:32.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff866575640 1 --2- 10.20.193.40:0/1362860221 >> v2:10.20.193.120:6800/397309233 conn(0x7ff8340740f0 0x7ff8340945a0 secure :-1 s=READY pgs=2262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff85c002920 tx=0x7ff85c007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.238 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.231+0000 7ff84effd640 1 -- 10.20.193.40:0/1362860221 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7ff8500169d0 con 0x7ff86813d5d0 2026-02-24T17:30:32.317 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7ff8680b3480 con 0x7ff8340740f0 2026-02-24T17:30:32.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff84effd640 1 -- 10.20.193.40:0/1362860221 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7ff8680b3480 con 0x7ff8340740f0 2026-02-24T17:30:32.319 INFO:teuthology.orchestra.run.trial040.stderr:instructed osd(s) 15 to deep-scrub 2026-02-24T17:30:32.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 10 librados: watch_flush enter 2026-02-24T17:30:32.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 10 librados: watch_flush exit 2026-02-24T17:30:32.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 20 client.25500.objecter shutdown clearing up homeless session... 2026-02-24T17:30:32.319 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 10 client.25500.objecter successfully canceled tick 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 >> v2:10.20.193.120:6800/397309233 conn(0x7ff8340740f0 msgr2=0x7ff8340945a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 --2- 10.20.193.40:0/1362860221 >> v2:10.20.193.120:6800/397309233 conn(0x7ff8340740f0 0x7ff8340945a0 secure :-1 s=READY pgs=2262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff85c002920 tx=0x7ff85c007d70 comp rx=0 tx=0).stop 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff86813d5d0 msgr2=0x7ff86805d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff86813d5d0 0x7ff86805d1b0 secure :-1 s=READY pgs=5222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff850007c10 tx=0x7ff854005900 comp rx=0 tx=0).stop 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 shutdown_connections 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 --2- 10.20.193.40:0/1362860221 >> v2:10.20.193.120:6800/397309233 conn(0x7ff8340740f0 0x7ff8340945a0 unknown :-1 s=CLOSED pgs=2262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7ff86805d6f0 0x7ff868134220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7ff86813d5d0 0x7ff86805d1b0 unknown :-1 s=CLOSED pgs=5222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 --2- 10.20.193.40:0/1362860221 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7ff8540048d0 0x7ff868147c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.320 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 >> 10.20.193.40:0/1362860221 conn(0x7ff8680b8fd0 msgr2=0x7ff8680b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 shutdown_connections 2026-02-24T17:30:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 -- 10.20.193.40:0/1362860221 wait complete. 2026-02-24T17:30:32.321 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.319+0000 7ff86c862640 1 librados: shutdown 2026-02-24T17:30:32.329 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T17:30:32.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73aa8d8640 1 Processor -- start 2026-02-24T17:30:32.388 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73aa8d8640 1 -- start start 2026-02-24T17:30:32.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73aa8d8640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f73a40b4320 0x7f73a40b4780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73aa8d8640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a40b4cc0 con 0x7f73a40b28d0 2026-02-24T17:30:32.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73aa8d8640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a41651b0 con 0x7f73a40b2500 2026-02-24T17:30:32.389 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73aa8d8640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f73a4165490 con 0x7f73a40b4320 2026-02-24T17:30:32.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73a8e4e640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f73a40b4320 0x7f73a40b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73a37fe640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f73a40b28d0 0x7f73a4164910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:58324/0 (socket says 10.20.193.40:58324) 2026-02-24T17:30:32.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73a37fe640 1 -- 10.20.193.40:0/2819702032 learned_addr learned my addr 10.20.193.40:0/2819702032 (peer_addr_for_me v1:10.20.193.40:0/0) 2026-02-24T17:30:32.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73a8e4e640 1 --2- 10.20.193.40:0/2819702032 >> v2:10.20.193.40:3300/0 conn(0x7f73a40b4320 0x7f73a40b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32900/0 (socket says 10.20.193.40:32900) 2026-02-24T17:30:32.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73a8e4e640 1 -- 10.20.193.40:0/2819702032 >> v1:10.20.193.109:6789/0 conn(0x7f73a40b2500 legacy=0x7f73a4168840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73a8e4e640 1 -- 10.20.193.40:0/2819702032 >> v1:10.20.193.40:6789/0 conn(0x7f73a40b28d0 legacy=0x7f73a4164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.390 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.387+0000 7f73a8e4e640 1 -- 10.20.193.40:0/2819702032 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a4165770 con 0x7f73a40b4320 2026-02-24T17:30:32.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a8e4e640 1 --2- 10.20.193.40:0/2819702032 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b4320 0x7f73a40b4780 secure :-1 s=READY pgs=5225 gs=3 cs=0 l=1 c_cookie=1659735052378505284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7398005c90 tx=0x7f739801d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1708903c8a490044 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a2ffd640 1 -- 10.20.193.40:0/2819702032 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73980b3070 con 0x7f73a40b4320 2026-02-24T17:30:32.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a2ffd640 1 -- 10.20.193.40:0/2819702032 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73980a6750 con 0x7f73a40b4320 2026-02-24T17:30:32.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a2ffd640 1 -- 10.20.193.40:0/2819702032 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73980a6b60 con 0x7f73a40b4320 2026-02-24T17:30:32.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- 10.20.193.40:0/2819702032 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b4320 msgr2=0x7f73a40b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.392 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 --2- 10.20.193.40:0/2819702032 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b4320 0x7f73a40b4780 secure :-1 s=READY pgs=5225 gs=3 cs=0 l=1 c_cookie=1659735052378505284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7398005c90 tx=0x7f739801d860 comp rx=0 tx=0).stop 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- 10.20.193.40:0/2819702032 shutdown_connections 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 --2- 10.20.193.40:0/2819702032 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b4320 0x7f73a40b4780 unknown :-1 s=CLOSED pgs=5225 gs=3 cs=0 l=1 c_cookie=1659735052378505284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- 10.20.193.40:0/2819702032 >> 10.20.193.40:0/2819702032 conn(0x7f73a40b8fd0 msgr2=0x7f73a40b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- 10.20.193.40:0/2819702032 shutdown_connections 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- 10.20.193.40:0/2819702032 wait complete. 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 librados: starting msgr at 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 librados: starting objecter 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 Processor -- start 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- start start 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 librados: setting wanted keys 2026-02-24T17:30:32.393 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 librados: calling monclient init 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f73a40b2500 0x7f73a413d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b28d0 0x7f73a417bc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f73a40b4320 0x7f73a40b1290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f73a40567f0 con 0x7f73a40b28d0 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f73a41cc240 con 0x7f73a40b4320 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73aa8d8640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f73a415c970 con 0x7f73a40b2500 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a37fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b28d0 0x7f73a417bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a37fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b28d0 0x7f73a417bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:32902/0 (socket says 10.20.193.40:32902) 2026-02-24T17:30:32.397 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a37fe640 1 -- 10.20.193.40:0/202105351 learned_addr learned my addr 10.20.193.40:0/202105351 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a3fff640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f73a40b2500 0x7f73a413d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.391+0000 7f73a8e4e640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f73a40b4320 0x7f73a40b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a37fe640 1 -- 10.20.193.40:0/202105351 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f73a40b2500 msgr2=0x7f73a413d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a37fe640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f73a40b2500 0x7f73a413d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a37fe640 1 -- 10.20.193.40:0/202105351 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f73a40b4320 msgr2=0x7f73a40b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a37fe640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f73a40b4320 0x7f73a40b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a37fe640 1 -- 10.20.193.40:0/202105351 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a4161fc0 con 0x7f73a40b28d0 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a8e4e640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f73a40b4320 0x7f73a40b1290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a37fe640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b28d0 0x7f73a417bc30 secure :-1 s=READY pgs=5226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f739400c4d0 tx=0x7f739400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 10 client.?.objecter ms_handle_connect 0x7f73a40b28d0 2026-02-24T17:30:32.398 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 1 -- 10.20.193.40:0/202105351 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7394017070 con 0x7f73a40b28d0 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 1 -- 10.20.193.40:0/202105351 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7394005e00 con 0x7f73a40b28d0 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a417a3e0 con 0x7f73a40b28d0 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 1 -- 10.20.193.40:0/202105351 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73940072d0 con 0x7f73a40b28d0 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73aa8d8640 10 client.25509.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a40b04d0 con 0x7f73a40b28d0 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73aa8d8640 1 librados: init done 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a40b46f0 con 0x7f73a40b28d0 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 1 -- 10.20.193.40:0/202105351 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f7394007470 con 0x7f73a40b28d0 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 1 --2- 10.20.193.40:0/202105351 >> v2:10.20.193.120:6800/397309233 conn(0x7f7374074100 0x7f73740945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 1 -- 10.20.193.40:0/202105351 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f73940957f0 con 0x7f73a40b28d0 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 10 client.25509.objecter ms_dispatch2 0x7f73a4000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:32.399 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 3 client.25509.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:32.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 3 client.25509.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:32.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a3fff640 1 --2- 10.20.193.40:0/202105351 >> v2:10.20.193.120:6800/397309233 conn(0x7f7374074100 0x7f73740945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:32.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 20 client.25509.objecter dump_active .. 0 homeless 2026-02-24T17:30:32.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a3fff640 1 --2- 10.20.193.40:0/202105351 >> v2:10.20.193.120:6800/397309233 conn(0x7f7374074100 0x7f73740945b0 secure :-1 s=READY pgs=2263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7390007fd0 tx=0x7f7390007f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:32.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.395+0000 7f73a0ff9640 10 client.25509.objecter ms_handle_connect 0x7f7374074100 2026-02-24T17:30:32.400 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.399+0000 7f73a0ff9640 1 -- 10.20.193.40:0/202105351 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f73a4161fc0 con 0x7f73a40b28d0 2026-02-24T17:30:32.483 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.483+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73a40affa0 con 0x7f7374074100 2026-02-24T17:30:32.485 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73a0ff9640 1 -- 10.20.193.40:0/202105351 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+124946 (secure 0 0 0) 0x7f73a40affa0 con 0x7f7374074100 2026-02-24T17:30:32.486 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:30:32.487 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-24T17:30:32.489 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 10 librados: watch_flush enter 2026-02-24T17:30:32.489 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 10 librados: watch_flush exit 2026-02-24T17:30:32.489 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 20 client.25509.objecter shutdown clearing up homeless session... 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 10 client.25509.objecter successfully canceled tick 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 >> v2:10.20.193.120:6800/397309233 conn(0x7f7374074100 msgr2=0x7f73740945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 --2- 10.20.193.40:0/202105351 >> v2:10.20.193.120:6800/397309233 conn(0x7f7374074100 0x7f73740945b0 secure :-1 s=READY pgs=2263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7390007fd0 tx=0x7f7390007f20 comp rx=0 tx=0).stop 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b28d0 msgr2=0x7f73a417bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b28d0 0x7f73a417bc30 secure :-1 s=READY pgs=5226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f739400c4d0 tx=0x7f739400c990 comp rx=0 tx=0).stop 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 shutdown_connections 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 --2- 10.20.193.40:0/202105351 >> v2:10.20.193.120:6800/397309233 conn(0x7f7374074100 0x7f73740945b0 unknown :-1 s=CLOSED pgs=2263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f73a40b4320 0x7f73a40b1290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f73a40b28d0 0x7f73a417bc30 unknown :-1 s=CLOSED pgs=5226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.490 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 --2- 10.20.193.40:0/202105351 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f73a40b2500 0x7f73a413d7d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:32.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 >> 10.20.193.40:0/202105351 conn(0x7f73a40b8fd0 msgr2=0x7f73a4057ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:32.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 shutdown_connections 2026-02-24T17:30:32.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 -- 10.20.193.40:0/202105351 wait complete. 2026-02-24T17:30:32.491 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:32.487+0000 7f73aa8d8640 1 librados: shutdown 2026-02-24T17:30:32.498 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":468,"stamp":"2026-02-24T17:30:31.916902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":246,"num_write_kb":4773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":519372,"kb_used_data":88012,"kb_used_omap":25027,"kb_used_meta":406076,"kb_avail":1509430068,"statfs":{"total":1546188226560,"available":1545656389632,"internally_reserved":0,"allocated":90124288,"data_stored":53304971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25628640,"internal_metadata":415821856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001503"},"pg_stats":[{"pgid":"15.13","version":"0'0","reported_seq":565,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814772+0000","last_change":"2026-02-24T17:25:36.929977+0000","last_active":"2026-02-24T17:30:16.814772+0000","last_peered":"2026-02-24T17:30:16.814772+0000","last_clean":"2026-02-24T17:30:16.814772+0000","last_became_active":"2026-02-24T17:25:36.924928+0000","last_became_peered":"2026-02-24T17:25:36.924928+0000","last_unstale":"2026-02-24T17:30:16.814772+0000","last_undegraded":"2026-02-24T17:30:16.814772+0000","last_fullsized":"2026-02-24T17:30:16.814772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:49.788613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.894846+0000","last_change":"2026-02-24T17:25:36.978515+0000","last_active":"2026-02-24T17:30:16.894846+0000","last_peered":"2026-02-24T17:30:16.894846+0000","last_clean":"2026-02-24T17:30:16.894846+0000","last_became_active":"2026-02-24T17:25:36.978414+0000","last_became_peered":"2026-02-24T17:25:36.978414+0000","last_unstale":"2026-02-24T17:30:16.894846+0000","last_undegraded":"2026-02-24T17:30:16.894846+0000","last_fullsized":"2026-02-24T17:30:16.894846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:32:38.297792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816104+0000","last_change":"2026-02-24T17:25:36.967706+0000","last_active":"2026-02-24T17:30:16.816104+0000","last_peered":"2026-02-24T17:30:16.816104+0000","last_clean":"2026-02-24T17:30:16.816104+0000","last_became_active":"2026-02-24T17:25:36.967440+0000","last_became_peered":"2026-02-24T17:25:36.967440+0000","last_unstale":"2026-02-24T17:30:16.816104+0000","last_undegraded":"2026-02-24T17:30:16.816104+0000","last_fullsized":"2026-02-24T17:30:16.816104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:46:54.102811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.240878+0000","last_change":"2026-02-24T17:30:30.240878+0000","last_active":"2026-02-24T17:30:30.240878+0000","last_peered":"2026-02-24T17:30:30.240878+0000","last_clean":"2026-02-24T17:30:30.240878+0000","last_became_active":"2026-02-24T17:25:36.927701+0000","last_became_peered":"2026-02-24T17:25:36.927701+0000","last_unstale":"2026-02-24T17:30:30.240878+0000","last_undegraded":"2026-02-24T17:30:30.240878+0000","last_fullsized":"2026-02-24T17:30:30.240878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.240829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.240829+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.240829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:40:11.310198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":566,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.474658+0000","last_change":"2026-02-24T17:30:30.474658+0000","last_active":"2026-02-24T17:30:30.474658+0000","last_peered":"2026-02-24T17:30:30.474658+0000","last_clean":"2026-02-24T17:30:30.474658+0000","last_became_active":"2026-02-24T17:25:36.959978+0000","last_became_peered":"2026-02-24T17:25:36.959978+0000","last_unstale":"2026-02-24T17:30:30.474658+0000","last_undegraded":"2026-02-24T17:30:30.474658+0000","last_fullsized":"2026-02-24T17:30:30.474658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.474596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.474596+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.474596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:46:43.988119+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":565,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814563+0000","last_change":"2026-02-24T17:25:36.948273+0000","last_active":"2026-02-24T17:30:16.814563+0000","last_peered":"2026-02-24T17:30:16.814563+0000","last_clean":"2026-02-24T17:30:16.814563+0000","last_became_active":"2026-02-24T17:25:36.947821+0000","last_became_peered":"2026-02-24T17:25:36.947821+0000","last_unstale":"2026-02-24T17:30:16.814563+0000","last_undegraded":"2026-02-24T17:30:16.814563+0000","last_fullsized":"2026-02-24T17:30:16.814563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:29:10.189794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307955+0000","last_change":"2026-02-24T17:25:36.971834+0000","last_active":"2026-02-24T17:30:16.307955+0000","last_peered":"2026-02-24T17:30:16.307955+0000","last_clean":"2026-02-24T17:30:16.307955+0000","last_became_active":"2026-02-24T17:25:36.971529+0000","last_became_peered":"2026-02-24T17:25:36.971529+0000","last_unstale":"2026-02-24T17:30:16.307955+0000","last_undegraded":"2026-02-24T17:30:16.307955+0000","last_fullsized":"2026-02-24T17:30:16.307955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:08:47.585158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.307934+0000","last_change":"2026-02-24T17:25:36.971133+0000","last_active":"2026-02-24T17:30:16.307934+0000","last_peered":"2026-02-24T17:30:16.307934+0000","last_clean":"2026-02-24T17:30:16.307934+0000","last_became_active":"2026-02-24T17:25:36.970412+0000","last_became_peered":"2026-02-24T17:25:36.970412+0000","last_unstale":"2026-02-24T17:30:16.307934+0000","last_undegraded":"2026-02-24T17:30:16.307934+0000","last_fullsized":"2026-02-24T17:30:16.307934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:05:49.568228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420711+0000","last_change":"2026-02-24T17:25:37.009919+0000","last_active":"2026-02-24T17:30:16.420711+0000","last_peered":"2026-02-24T17:30:16.420711+0000","last_clean":"2026-02-24T17:30:16.420711+0000","last_became_active":"2026-02-24T17:25:37.003886+0000","last_became_peered":"2026-02-24T17:25:37.003886+0000","last_unstale":"2026-02-24T17:30:16.420711+0000","last_undegraded":"2026-02-24T17:30:16.420711+0000","last_fullsized":"2026-02-24T17:30:16.420711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:18:05.631610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":572,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.264445+0000","last_change":"2026-02-24T17:30:30.264445+0000","last_active":"2026-02-24T17:30:30.264445+0000","last_peered":"2026-02-24T17:30:30.264445+0000","last_clean":"2026-02-24T17:30:30.264445+0000","last_became_active":"2026-02-24T17:25:36.942964+0000","last_became_peered":"2026-02-24T17:25:36.942964+0000","last_unstale":"2026-02-24T17:30:30.264445+0000","last_undegraded":"2026-02-24T17:30:30.264445+0000","last_fullsized":"2026-02-24T17:30:30.264445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.264381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.264381+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.264381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:11:30.432837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":566,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:29.513011+0000","last_change":"2026-02-24T17:30:29.513011+0000","last_active":"2026-02-24T17:30:29.513011+0000","last_peered":"2026-02-24T17:30:29.513011+0000","last_clean":"2026-02-24T17:30:29.513011+0000","last_became_active":"2026-02-24T17:25:36.953877+0000","last_became_peered":"2026-02-24T17:25:36.953877+0000","last_unstale":"2026-02-24T17:30:29.513011+0000","last_undegraded":"2026-02-24T17:30:29.513011+0000","last_fullsized":"2026-02-24T17:30:29.513011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:29.512956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:29.512956+0000","last_clean_scrub_stamp":"2026-02-24T17:30:29.512956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:42:02.662093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420751+0000","last_change":"2026-02-24T17:25:37.007119+0000","last_active":"2026-02-24T17:30:16.420751+0000","last_peered":"2026-02-24T17:30:16.420751+0000","last_clean":"2026-02-24T17:30:16.420751+0000","last_became_active":"2026-02-24T17:25:36.996719+0000","last_became_peered":"2026-02-24T17:25:36.996719+0000","last_unstale":"2026-02-24T17:30:16.420751+0000","last_undegraded":"2026-02-24T17:30:16.420751+0000","last_fullsized":"2026-02-24T17:30:16.420751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:07:13.684127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":585,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.161032+0000","last_change":"2026-02-24T17:30:31.161032+0000","last_active":"2026-02-24T17:30:31.161032+0000","last_peered":"2026-02-24T17:30:31.161032+0000","last_clean":"2026-02-24T17:30:31.161032+0000","last_became_active":"2026-02-24T17:25:08.378421+0000","last_became_peered":"2026-02-24T17:25:08.378421+0000","last_unstale":"2026-02-24T17:30:31.161032+0000","last_undegraded":"2026-02-24T17:30:31.161032+0000","last_fullsized":"2026-02-24T17:30:31.161032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.160980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.160980+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.160980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:23.171614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816773+0000","last_change":"2026-02-24T17:25:36.961132+0000","last_active":"2026-02-24T17:30:16.816773+0000","last_peered":"2026-02-24T17:30:16.816773+0000","last_clean":"2026-02-24T17:30:16.816773+0000","last_became_active":"2026-02-24T17:25:36.959088+0000","last_became_peered":"2026-02-24T17:25:36.959088+0000","last_unstale":"2026-02-24T17:30:16.816773+0000","last_undegraded":"2026-02-24T17:30:16.816773+0000","last_fullsized":"2026-02-24T17:30:16.816773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:49:13.731672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":580,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.814870+0000","last_change":"2026-02-24T17:25:10.079278+0000","last_active":"2026-02-24T17:30:16.814870+0000","last_peered":"2026-02-24T17:30:16.814870+0000","last_clean":"2026-02-24T17:30:16.814870+0000","last_became_active":"2026-02-24T17:25:07.858311+0000","last_became_peered":"2026-02-24T17:25:07.858311+0000","last_unstale":"2026-02-24T17:30:16.814870+0000","last_undegraded":"2026-02-24T17:30:16.814870+0000","last_fullsized":"2026-02-24T17:30:16.814870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:29:45.741836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030397399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816056+0000","last_change":"2026-02-24T17:25:36.951453+0000","last_active":"2026-02-24T17:30:16.816056+0000","last_peered":"2026-02-24T17:30:16.816056+0000","last_clean":"2026-02-24T17:30:16.816056+0000","last_became_active":"2026-02-24T17:25:36.949632+0000","last_became_peered":"2026-02-24T17:25:36.949632+0000","last_unstale":"2026-02-24T17:30:16.816056+0000","last_undegraded":"2026-02-24T17:30:16.816056+0000","last_fullsized":"2026-02-24T17:30:16.816056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:29:49.423443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":583,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.327708+0000","last_change":"2026-02-24T17:30:30.327708+0000","last_active":"2026-02-24T17:30:30.327708+0000","last_peered":"2026-02-24T17:30:30.327708+0000","last_clean":"2026-02-24T17:30:30.327708+0000","last_became_active":"2026-02-24T17:25:08.084075+0000","last_became_peered":"2026-02-24T17:25:08.084075+0000","last_unstale":"2026-02-24T17:30:30.327708+0000","last_undegraded":"2026-02-24T17:30:30.327708+0000","last_fullsized":"2026-02-24T17:30:30.327708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.327657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.327657+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.327657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:14:22.239778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000244684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816505+0000","last_change":"2026-02-24T17:25:36.950428+0000","last_active":"2026-02-24T17:30:16.816505+0000","last_peered":"2026-02-24T17:30:16.816505+0000","last_clean":"2026-02-24T17:30:16.816505+0000","last_became_active":"2026-02-24T17:25:36.941218+0000","last_became_peered":"2026-02-24T17:25:36.941218+0000","last_unstale":"2026-02-24T17:30:16.816505+0000","last_undegraded":"2026-02-24T17:30:16.816505+0000","last_fullsized":"2026-02-24T17:30:16.816505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:09:01.212669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":578,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816182+0000","last_change":"2026-02-24T17:25:10.079275+0000","last_active":"2026-02-24T17:30:16.816182+0000","last_peered":"2026-02-24T17:30:16.816182+0000","last_clean":"2026-02-24T17:30:16.816182+0000","last_became_active":"2026-02-24T17:25:07.858281+0000","last_became_peered":"2026-02-24T17:25:07.858281+0000","last_unstale":"2026-02-24T17:30:16.816182+0000","last_undegraded":"2026-02-24T17:30:16.816182+0000","last_fullsized":"2026-02-24T17:30:16.816182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:44:14.965746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028402800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":568,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:28.167714+0000","last_change":"2026-02-24T17:30:28.167714+0000","last_active":"2026-02-24T17:30:28.167714+0000","last_peered":"2026-02-24T17:30:28.167714+0000","last_clean":"2026-02-24T17:30:28.167714+0000","last_became_active":"2026-02-24T17:25:36.943923+0000","last_became_peered":"2026-02-24T17:25:36.943923+0000","last_unstale":"2026-02-24T17:30:28.167714+0000","last_undegraded":"2026-02-24T17:30:28.167714+0000","last_fullsized":"2026-02-24T17:30:28.167714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:28.167634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:28.167634+0000","last_clean_scrub_stamp":"2026-02-24T17:30:28.167634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:01:18.091188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"311'3","reported_seq":588,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.124308+0000","last_change":"2026-02-24T17:30:30.124308+0000","last_active":"2026-02-24T17:30:30.124308+0000","last_peered":"2026-02-24T17:30:30.124308+0000","last_clean":"2026-02-24T17:30:30.124308+0000","last_became_active":"2026-02-24T17:25:08.074872+0000","last_became_peered":"2026-02-24T17:25:08.074872+0000","last_unstale":"2026-02-24T17:30:30.124308+0000","last_undegraded":"2026-02-24T17:30:30.124308+0000","last_fullsized":"2026-02-24T17:30:30.124308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"311'3","last_scrub_stamp":"2026-02-24T17:30:30.124268+0000","last_deep_scrub":"311'3","last_deep_scrub_stamp":"2026-02-24T17:30:30.124268+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.124268+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:15:34.113677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089238299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":566,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:28.532303+0000","last_change":"2026-02-24T17:30:28.532303+0000","last_active":"2026-02-24T17:30:28.532303+0000","last_peered":"2026-02-24T17:30:28.532303+0000","last_clean":"2026-02-24T17:30:28.532303+0000","last_became_active":"2026-02-24T17:25:36.947822+0000","last_became_peered":"2026-02-24T17:25:36.947822+0000","last_unstale":"2026-02-24T17:30:28.532303+0000","last_undegraded":"2026-02-24T17:30:28.532303+0000","last_fullsized":"2026-02-24T17:30:28.532303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:28.532242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:28.532242+0000","last_clean_scrub_stamp":"2026-02-24T17:30:28.532242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:19:25.661320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":577,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303454+0000","last_change":"2026-02-24T17:25:10.079008+0000","last_active":"2026-02-24T17:30:16.303454+0000","last_peered":"2026-02-24T17:30:16.303454+0000","last_clean":"2026-02-24T17:30:16.303454+0000","last_became_active":"2026-02-24T17:25:07.860331+0000","last_became_peered":"2026-02-24T17:25:07.860331+0000","last_unstale":"2026-02-24T17:30:16.303454+0000","last_undegraded":"2026-02-24T17:30:16.303454+0000","last_fullsized":"2026-02-24T17:30:16.303454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:34:57.054779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023849400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":572,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.317203+0000","last_change":"2026-02-24T17:30:31.317203+0000","last_active":"2026-02-24T17:30:31.317203+0000","last_peered":"2026-02-24T17:30:31.317203+0000","last_clean":"2026-02-24T17:30:31.317203+0000","last_became_active":"2026-02-24T17:25:36.988342+0000","last_became_peered":"2026-02-24T17:25:36.988342+0000","last_unstale":"2026-02-24T17:30:31.317203+0000","last_undegraded":"2026-02-24T17:30:31.317203+0000","last_fullsized":"2026-02-24T17:30:31.317203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.317129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.317129+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.317129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:56:43.110737+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":585,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:29.150400+0000","last_change":"2026-02-24T17:30:29.150400+0000","last_active":"2026-02-24T17:30:29.150400+0000","last_peered":"2026-02-24T17:30:29.150400+0000","last_clean":"2026-02-24T17:30:29.150400+0000","last_became_active":"2026-02-24T17:25:08.184697+0000","last_became_peered":"2026-02-24T17:25:08.184697+0000","last_unstale":"2026-02-24T17:30:29.150400+0000","last_undegraded":"2026-02-24T17:30:29.150400+0000","last_fullsized":"2026-02-24T17:30:29.150400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:29.150340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:29.150340+0000","last_clean_scrub_stamp":"2026-02-24T17:30:29.150340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:14:14.609486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064636800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420858+0000","last_change":"2026-02-24T17:25:37.008582+0000","last_active":"2026-02-24T17:30:16.420858+0000","last_peered":"2026-02-24T17:30:16.420858+0000","last_clean":"2026-02-24T17:30:16.420858+0000","last_became_active":"2026-02-24T17:25:36.995692+0000","last_became_peered":"2026-02-24T17:25:36.995692+0000","last_unstale":"2026-02-24T17:30:16.420858+0000","last_undegraded":"2026-02-24T17:30:16.420858+0000","last_fullsized":"2026-02-24T17:30:16.420858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:44:14.151677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":578,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303566+0000","last_change":"2026-02-24T17:25:10.079028+0000","last_active":"2026-02-24T17:30:16.303566+0000","last_peered":"2026-02-24T17:30:16.303566+0000","last_clean":"2026-02-24T17:30:16.303566+0000","last_became_active":"2026-02-24T17:25:08.090187+0000","last_became_peered":"2026-02-24T17:25:08.090187+0000","last_unstale":"2026-02-24T17:30:16.303566+0000","last_undegraded":"2026-02-24T17:30:16.303566+0000","last_fullsized":"2026-02-24T17:30:16.303566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:06.836809+0000","last_clean_scrub_stamp":"2026-02-24T17:25:06.836809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:14:10.801138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024157000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"311'194","reported_seq":813,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.556643+0000","last_change":"2026-02-24T17:30:31.556643+0000","last_active":"2026-02-24T17:30:31.556643+0000","last_peered":"2026-02-24T17:30:31.556643+0000","last_clean":"2026-02-24T17:30:31.556643+0000","last_became_active":"2026-02-24T17:25:04.113696+0000","last_became_peered":"2026-02-24T17:25:04.113696+0000","last_unstale":"2026-02-24T17:30:31.556643+0000","last_undegraded":"2026-02-24T17:30:31.556643+0000","last_fullsized":"2026-02-24T17:30:31.556643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"311'194","last_scrub_stamp":"2026-02-24T17:30:31.556586+0000","last_deep_scrub":"311'194","last_deep_scrub_stamp":"2026-02-24T17:30:31.556586+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.556586+0000","objects_scrubbed":2,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:57:33.535557+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816130+0000","last_change":"2026-02-24T17:25:36.951158+0000","last_active":"2026-02-24T17:30:16.816130+0000","last_peered":"2026-02-24T17:30:16.816130+0000","last_clean":"2026-02-24T17:30:16.816130+0000","last_became_active":"2026-02-24T17:25:36.949323+0000","last_became_peered":"2026-02-24T17:25:36.949323+0000","last_unstale":"2026-02-24T17:30:16.816130+0000","last_undegraded":"2026-02-24T17:30:16.816130+0000","last_fullsized":"2026-02-24T17:30:16.816130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:00:33.896080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":566,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.190690+0000","last_change":"2026-02-24T17:30:30.190690+0000","last_active":"2026-02-24T17:30:30.190690+0000","last_peered":"2026-02-24T17:30:30.190690+0000","last_clean":"2026-02-24T17:30:30.190690+0000","last_became_active":"2026-02-24T17:25:36.939263+0000","last_became_peered":"2026-02-24T17:25:36.939263+0000","last_unstale":"2026-02-24T17:30:30.190690+0000","last_undegraded":"2026-02-24T17:30:30.190690+0000","last_fullsized":"2026-02-24T17:30:30.190690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.190634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.190634+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.190634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:00:49.298451+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":559,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816440+0000","last_change":"2026-02-24T17:25:36.938520+0000","last_active":"2026-02-24T17:30:16.816440+0000","last_peered":"2026-02-24T17:30:16.816440+0000","last_clean":"2026-02-24T17:30:16.816440+0000","last_became_active":"2026-02-24T17:25:36.936185+0000","last_became_peered":"2026-02-24T17:25:36.936185+0000","last_unstale":"2026-02-24T17:30:16.816440+0000","last_undegraded":"2026-02-24T17:30:16.816440+0000","last_fullsized":"2026-02-24T17:30:16.816440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:09:43.790677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.303659+0000","last_change":"2026-02-24T17:25:36.953789+0000","last_active":"2026-02-24T17:30:16.303659+0000","last_peered":"2026-02-24T17:30:16.303659+0000","last_clean":"2026-02-24T17:30:16.303659+0000","last_became_active":"2026-02-24T17:25:36.949495+0000","last_became_peered":"2026-02-24T17:25:36.949495+0000","last_unstale":"2026-02-24T17:30:16.303659+0000","last_undegraded":"2026-02-24T17:30:16.303659+0000","last_fullsized":"2026-02-24T17:30:16.303659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:10.043156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816224+0000","last_change":"2026-02-24T17:25:36.988365+0000","last_active":"2026-02-24T17:30:16.816224+0000","last_peered":"2026-02-24T17:30:16.816224+0000","last_clean":"2026-02-24T17:30:16.816224+0000","last_became_active":"2026-02-24T17:25:36.988207+0000","last_became_peered":"2026-02-24T17:25:36.988207+0000","last_unstale":"2026-02-24T17:30:16.816224+0000","last_undegraded":"2026-02-24T17:30:16.816224+0000","last_fullsized":"2026-02-24T17:30:16.816224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:44:31.138787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420667+0000","last_change":"2026-02-24T17:25:37.008436+0000","last_active":"2026-02-24T17:30:16.420667+0000","last_peered":"2026-02-24T17:30:16.420667+0000","last_clean":"2026-02-24T17:30:16.420667+0000","last_became_active":"2026-02-24T17:25:37.002254+0000","last_became_peered":"2026-02-24T17:25:37.002254+0000","last_unstale":"2026-02-24T17:30:16.420667+0000","last_undegraded":"2026-02-24T17:30:16.420667+0000","last_fullsized":"2026-02-24T17:30:16.420667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:10:08.553481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"311'12","reported_seq":593,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.217936+0000","last_change":"2026-02-24T17:30:31.217936+0000","last_active":"2026-02-24T17:30:31.217936+0000","last_peered":"2026-02-24T17:30:31.217936+0000","last_clean":"2026-02-24T17:30:31.217936+0000","last_became_active":"2026-02-24T17:25:36.954370+0000","last_became_peered":"2026-02-24T17:25:36.954370+0000","last_unstale":"2026-02-24T17:30:31.217936+0000","last_undegraded":"2026-02-24T17:30:31.217936+0000","last_fullsized":"2026-02-24T17:30:31.217936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"311'12","last_scrub_stamp":"2026-02-24T17:30:31.217858+0000","last_deep_scrub":"311'12","last_deep_scrub_stamp":"2026-02-24T17:30:31.217858+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.217858+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:04:15.892289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":563,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816819+0000","last_change":"2026-02-24T17:25:36.967349+0000","last_active":"2026-02-24T17:30:16.816819+0000","last_peered":"2026-02-24T17:30:16.816819+0000","last_clean":"2026-02-24T17:30:16.816819+0000","last_became_active":"2026-02-24T17:25:36.967164+0000","last_became_peered":"2026-02-24T17:25:36.967164+0000","last_unstale":"2026-02-24T17:30:16.816819+0000","last_undegraded":"2026-02-24T17:30:16.816819+0000","last_fullsized":"2026-02-24T17:30:16.816819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:24:47.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":561,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.603289+0000","last_change":"2026-02-24T17:25:36.943423+0000","last_active":"2026-02-24T17:30:16.603289+0000","last_peered":"2026-02-24T17:30:16.603289+0000","last_clean":"2026-02-24T17:30:16.603289+0000","last_became_active":"2026-02-24T17:25:36.941089+0000","last_became_peered":"2026-02-24T17:25:36.941089+0000","last_unstale":"2026-02-24T17:30:16.603289+0000","last_undegraded":"2026-02-24T17:30:16.603289+0000","last_fullsized":"2026-02-24T17:30:16.603289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:21:37.674638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":562,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.816167+0000","last_change":"2026-02-24T17:25:36.939435+0000","last_active":"2026-02-24T17:30:16.816167+0000","last_peered":"2026-02-24T17:30:16.816167+0000","last_clean":"2026-02-24T17:30:16.816167+0000","last_became_active":"2026-02-24T17:25:36.938491+0000","last_became_peered":"2026-02-24T17:25:36.938491+0000","last_unstale":"2026-02-24T17:30:16.816167+0000","last_undegraded":"2026-02-24T17:30:16.816167+0000","last_fullsized":"2026-02-24T17:30:16.816167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:36:23.352712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":560,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.603937+0000","last_change":"2026-02-24T17:25:36.938161+0000","last_active":"2026-02-24T17:30:16.603937+0000","last_peered":"2026-02-24T17:30:16.603937+0000","last_clean":"2026-02-24T17:30:16.603937+0000","last_became_active":"2026-02-24T17:25:36.937025+0000","last_became_peered":"2026-02-24T17:25:36.937025+0000","last_unstale":"2026-02-24T17:30:16.603937+0000","last_undegraded":"2026-02-24T17:30:16.603937+0000","last_fullsized":"2026-02-24T17:30:16.603937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:40:14.141988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":564,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:16.420968+0000","last_change":"2026-02-24T17:25:36.988471+0000","last_active":"2026-02-24T17:30:16.420968+0000","last_peered":"2026-02-24T17:30:16.420968+0000","last_clean":"2026-02-24T17:30:16.420968+0000","last_became_active":"2026-02-24T17:25:36.985324+0000","last_became_peered":"2026-02-24T17:25:36.985324+0000","last_unstale":"2026-02-24T17:30:16.420968+0000","last_undegraded":"2026-02-24T17:30:16.420968+0000","last_fullsized":"2026-02-24T17:30:16.420968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:25:35.883143+0000","last_clean_scrub_stamp":"2026-02-24T17:25:35.883143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:56:48.935815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.285728+0000","last_change":"2026-02-24T17:30:31.285728+0000","last_active":"2026-02-24T17:30:31.285728+0000","last_peered":"2026-02-24T17:30:31.285728+0000","last_clean":"2026-02-24T17:30:31.285728+0000","last_became_active":"2026-02-24T17:25:36.928525+0000","last_became_peered":"2026-02-24T17:25:36.928525+0000","last_unstale":"2026-02-24T17:30:31.285728+0000","last_undegraded":"2026-02-24T17:30:31.285728+0000","last_fullsized":"2026-02-24T17:30:31.285728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.285674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.285674+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.285674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:37:00.975467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":2,"acting":2,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":2,"up_from":21,"seq":90194313284,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3248436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189403,"internal_metadata":27401253},"hb_peers":[0,1,3,4,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":21,"seq":90194313285,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2937,"kb_used_meta":24006,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3252877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3007961,"internal_metadata":24582695},"hb_peers":[0,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313286,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2993,"kb_used_meta":23950,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3267610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3065731,"internal_metadata":24524925},"hb_peers":[0,4,5,6,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313286,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":5412,"kb_used_omap":2970,"kb_used_meta":23973,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":5541888,"data_stored":3259528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3041792,"internal_metadata":24548864},"hb_peers":[1,3,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313285,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":5444,"kb_used_omap":5476,"kb_used_meta":21467,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":5574656,"data_stored":3262696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5607519,"internal_metadata":21983137},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313284,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":5400,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":5529600,"data_stored":3255127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[0,2,3,4,6,7,9,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313284,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3264371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3063988,"internal_metadata":24526668},"hb_peers":[0,2,4,5,7,8,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313284,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":183,"kb_used_meta":26760,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3244929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187407,"internal_metadata":27403249},"hb_peers":[1,3,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313285,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":5976,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":6119424,"data_stored":3835511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":192289,"internal_metadata":27398367},"hb_peers":[2,4,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313284,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":6020,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":6164480,"data_stored":3841297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188812,"internal_metadata":27401844},"hb_peers":[0,1,3,5,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313284,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":5468,"kb_used_omap":188,"kb_used_meta":26755,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":5599232,"data_stored":3272622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":193209,"internal_metadata":27397447},"hb_peers":[0,1,6,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313285,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":5448,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":5578752,"data_stored":3262562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":191672,"internal_metadata":27398984},"hb_peers":[0,3,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313285,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":5404,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":5533696,"data_stored":3252627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[2,4,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313284,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":5436,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":5566464,"data_stored":3261683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3064212,"internal_metadata":24526444},"hb_peers":[0,4,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313284,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2994,"kb_used_meta":23949,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3265804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3066142,"internal_metadata":24524514},"hb_peers":[0,2,3,4,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313285,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3257291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190563,"internal_metadata":27400093},"hb_peers":[1,3,4,6,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T17:30:32.505 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.506 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.506 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.506 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.506 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.507 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.507 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.507 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.507 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.507 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-24T17:25:06.836809+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=6, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.508 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.508 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.508 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-24T17:25:06.836809+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=6, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.508 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-24T17:25:06.836809+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=6, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.508 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.508 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-24T17:25:06.836809+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=6, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.509 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.509 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.509 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.509 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.509 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.509 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.510 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.510 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.510 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.510 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2026-02-24T17:25:35.883143+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=25, tm_sec=35, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=17, tm_min=30, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T17:30:32.510 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-24T17:30:52.512 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T17:30:52.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6044236640 1 Processor -- start 2026-02-24T17:30:52.584 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6044236640 1 -- start start 2026-02-24T17:30:52.587 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6044236640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f603c15d240 0x7f603c058810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.587 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6044236640 1 --2- >> v2:10.20.193.94:3300/0 conn(0x7f603c1676e0 0x7f603c058d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.587 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6044236640 1 -- --> v1:10.20.193.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f603c0b9ac0 con 0x7f603c15d610 2026-02-24T17:30:52.587 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6044236640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f603c0576b0 con 0x7f603c15d240 2026-02-24T17:30:52.587 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6044236640 1 -- --> v2:10.20.193.94:3300/0 -- mon_getmap magic: 0 -- 0x7f603c057990 con 0x7f603c1676e0 2026-02-24T17:30:52.587 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6041fab640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f603c15d240 0x7f603c058810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.587 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6041fab640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f603c15d240 0x7f603c058810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:54606/0 (socket says 10.20.193.40:54606) 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6041fab640 1 -- 10.20.193.40:0/3538019833 learned_addr learned my addr 10.20.193.40:0/3538019833 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f60427ac640 1 --1- >> v1:10.20.193.40:6789/0 conn(0x7f603c15d610 0x7f603c05b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.40:6789/0 says I am v1:10.20.193.40:38080/0 (socket says 10.20.193.40:38080) 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f60417aa640 1 --2- 10.20.193.40:0/3538019833 >> v2:10.20.193.94:3300/0 conn(0x7f603c1676e0 0x7f603c058d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6041fab640 1 -- 10.20.193.40:0/3538019833 >> v2:10.20.193.94:3300/0 conn(0x7f603c1676e0 msgr2=0x7f603c058d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6041fab640 1 --2- 10.20.193.40:0/3538019833 >> v2:10.20.193.94:3300/0 conn(0x7f603c1676e0 0x7f603c058d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.583+0000 7f6041fab640 1 -- 10.20.193.40:0/3538019833 >> v1:10.20.193.40:6789/0 conn(0x7f603c15d610 legacy=0x7f603c05b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6040fa9640 1 -- 10.20.193.40:0/3538019833 <== mon.0 v1:10.20.193.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748812414 0 0) 0x7f603c0b9ac0 con 0x7f603c15d610 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6041fab640 1 -- 10.20.193.40:0/3538019833 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603c057c70 con 0x7f603c15d240 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f60417aa640 1 --2- 10.20.193.40:0/3538019833 >> v2:10.20.193.94:3300/0 conn(0x7f603c1676e0 0x7f603c058d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6041fab640 1 --2- 10.20.193.40:0/3538019833 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d240 0x7f603c058810 secure :-1 s=READY pgs=5234 gs=2 cs=0 l=1 c_cookie=3942905463704464119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f602c0090a0 tx=0x7f602c01c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b803a0fb0d2af7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:52.588 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6040fa9640 1 -- 10.20.193.40:0/3538019833 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f602c0b0620 con 0x7f603c15d240 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6040fa9640 1 -- 10.20.193.40:0/3538019833 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602c0b07c0 con 0x7f603c15d240 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6040fa9640 1 -- 10.20.193.40:0/3538019833 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f602c0b0bb0 con 0x7f603c15d240 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- 10.20.193.40:0/3538019833 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d240 msgr2=0x7f603c058810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 --2- 10.20.193.40:0/3538019833 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d240 0x7f603c058810 secure :-1 s=READY pgs=5234 gs=2 cs=0 l=1 c_cookie=3942905463704464119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f602c0090a0 tx=0x7f602c01c5e0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- 10.20.193.40:0/3538019833 shutdown_connections 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 --2- 10.20.193.40:0/3538019833 >> v2:10.20.193.94:3300/0 conn(0x7f603c1676e0 0x7f603c058d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 --2- 10.20.193.40:0/3538019833 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d240 0x7f603c058810 unknown :-1 s=CLOSED pgs=5234 gs=2 cs=0 l=1 c_cookie=3942905463704464119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- 10.20.193.40:0/3538019833 >> 10.20.193.40:0/3538019833 conn(0x7f603c0baf90 msgr2=0x7f603c0bb390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- 10.20.193.40:0/3538019833 shutdown_connections 2026-02-24T17:30:52.589 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- 10.20.193.40:0/3538019833 wait complete. 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 librados: starting msgr at 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 librados: starting objecter 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 Processor -- start 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- start start 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 librados: setting wanted keys 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 librados: calling monclient init 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f603c15d240 0x7f603c15aa70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d610 0x7f603c11ea20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.593 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f603c1676e0 0x7f603c15c320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f603c0b9650 con 0x7f603c15d610 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f603c0b94d0 con 0x7f603c15d240 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.587+0000 7f6044236640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f603c0b97d0 con 0x7f603c1676e0 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d610 0x7f603c11ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d610 0x7f603c11ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:54614/0 (socket says 10.20.193.40:54614) 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 -- 10.20.193.40:0/3868777865 learned_addr learned my addr 10.20.193.40:0/3868777865 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f6041fab640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f603c15d240 0x7f603c15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60427ac640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f603c1676e0 0x7f603c15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 -- 10.20.193.40:0/3868777865 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f603c1676e0 msgr2=0x7f603c15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f603c1676e0 0x7f603c15c320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 -- 10.20.193.40:0/3868777865 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f603c15d240 msgr2=0x7f603c15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.594 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f603c15d240 0x7f603c15aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 -- 10.20.193.40:0/3868777865 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603c1cb1b0 con 0x7f603c15d610 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f60417aa640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d610 0x7f603c11ea20 secure :-1 s=READY pgs=5235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f603000c7c0 tx=0x7f603000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 10 client.?.objecter ms_handle_connect 0x7f603c15d610 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 1 -- 10.20.193.40:0/3868777865 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6030015070 con 0x7f603c15d610 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 1 -- 10.20.193.40:0/3868777865 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6030004240 con 0x7f603c15d610 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603c15b210 con 0x7f603c15d610 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 1 -- 10.20.193.40:0/3868777865 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6030007830 con 0x7f603c15d610 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f6044236640 10 client.25518.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f603c15b7d0 con 0x7f603c15d610 2026-02-24T17:30:52.595 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f6044236640 1 librados: init done 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603c05b2f0 con 0x7f603c15d610 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 1 -- 10.20.193.40:0/3868777865 <== mon.0 v2:10.20.193.40:3300/0 4 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f60300079d0 con 0x7f603c15d610 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 1 --2- 10.20.193.40:0/3868777865 >> v2:10.20.193.120:6800/397309233 conn(0x7f600c074100 0x7f600c0945b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 1 -- 10.20.193.40:0/3868777865 <== mon.0 v2:10.20.193.40:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f6030096440 con 0x7f603c15d610 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 10 client.25518.objecter ms_dispatch2 0x7f603c000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 3 client.25518.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 3 client.25518.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 20 client.25518.objecter dump_active .. 0 homeless 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f6041fab640 1 --2- 10.20.193.40:0/3868777865 >> v2:10.20.193.120:6800/397309233 conn(0x7f600c074100 0x7f600c0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.596 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f6041fab640 1 --2- 10.20.193.40:0/3868777865 >> v2:10.20.193.120:6800/397309233 conn(0x7f600c074100 0x7f600c0945b0 secure :-1 s=READY pgs=2264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f602c006d40 tx=0x7f602c0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:52.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 10 client.25518.objecter ms_handle_connect 0x7f600c074100 2026-02-24T17:30:52.597 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.591+0000 7f602a7fc640 1 -- 10.20.193.40:0/3868777865 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f603005ff70 con 0x7f603c15d610 2026-02-24T17:30:52.678 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.679+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 --> v2:10.20.193.120:6800/397309233 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f603c03b110 con 0x7f600c074100 2026-02-24T17:30:52.681 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f602a7fc640 1 -- 10.20.193.40:0/3868777865 <== mgr.4100 v2:10.20.193.120:6800/397309233 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+124951 (secure 0 0 0) 0x7f602c0dd830 con 0x7f600c074100 2026-02-24T17:30:52.682 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-24T17:30:52.683 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-24T17:30:52.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 10 librados: watch_flush enter 2026-02-24T17:30:52.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 10 librados: watch_flush exit 2026-02-24T17:30:52.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 20 client.25518.objecter shutdown clearing up homeless session... 2026-02-24T17:30:52.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 10 client.25518.objecter successfully canceled tick 2026-02-24T17:30:52.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 >> v2:10.20.193.120:6800/397309233 conn(0x7f600c074100 msgr2=0x7f600c0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 --2- 10.20.193.40:0/3868777865 >> v2:10.20.193.120:6800/397309233 conn(0x7f600c074100 0x7f600c0945b0 secure :-1 s=READY pgs=2264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f602c006d40 tx=0x7f602c0b3040 comp rx=0 tx=0).stop 2026-02-24T17:30:52.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d610 msgr2=0x7f603c11ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.685 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d610 0x7f603c11ea20 secure :-1 s=READY pgs=5235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f603000c7c0 tx=0x7f603000cc80 comp rx=0 tx=0).stop 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 shutdown_connections 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 --2- 10.20.193.40:0/3868777865 >> v2:10.20.193.120:6800/397309233 conn(0x7f600c074100 0x7f600c0945b0 unknown :-1 s=CLOSED pgs=2264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f603c1676e0 0x7f603c15c320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f603c15d610 0x7f603c11ea20 unknown :-1 s=CLOSED pgs=5235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 --2- 10.20.193.40:0/3868777865 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f603c15d240 0x7f603c15aa70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 >> 10.20.193.40:0/3868777865 conn(0x7f603c0baf90 msgr2=0x7f603c135870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 shutdown_connections 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 -- 10.20.193.40:0/3868777865 wait complete. 2026-02-24T17:30:52.686 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.683+0000 7f6044236640 1 librados: shutdown 2026-02-24T17:30:52.692 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2026-02-24T17:30:51.919420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":246,"num_write_kb":4773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":519372,"kb_used_data":88012,"kb_used_omap":25027,"kb_used_meta":406076,"kb_avail":1509430068,"statfs":{"total":1546188226560,"available":1545656389632,"internally_reserved":0,"allocated":90124288,"data_stored":53304971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25628640,"internal_metadata":415821856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001465"},"pg_stats":[{"pgid":"15.13","version":"0'0","reported_seq":573,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:33.801737+0000","last_change":"2026-02-24T17:30:33.801737+0000","last_active":"2026-02-24T17:30:33.801737+0000","last_peered":"2026-02-24T17:30:33.801737+0000","last_clean":"2026-02-24T17:30:33.801737+0000","last_became_active":"2026-02-24T17:25:36.924928+0000","last_became_peered":"2026-02-24T17:25:36.924928+0000","last_unstale":"2026-02-24T17:30:33.801737+0000","last_undegraded":"2026-02-24T17:30:33.801737+0000","last_fullsized":"2026-02-24T17:30:33.801737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:33.801686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:33.801686+0000","last_clean_scrub_stamp":"2026-02-24T17:30:33.801686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:16:28.926062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":567,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.674516+0000","last_change":"2026-02-24T17:30:31.674516+0000","last_active":"2026-02-24T17:30:31.674516+0000","last_peered":"2026-02-24T17:30:31.674516+0000","last_clean":"2026-02-24T17:30:31.674516+0000","last_became_active":"2026-02-24T17:25:36.978414+0000","last_became_peered":"2026-02-24T17:25:36.978414+0000","last_unstale":"2026-02-24T17:30:31.674516+0000","last_undegraded":"2026-02-24T17:30:31.674516+0000","last_fullsized":"2026-02-24T17:30:31.674516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.674462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.674462+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.674462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:06:10.751172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8],"acting":[3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:37.683226+0000","last_change":"2026-02-24T17:30:37.683226+0000","last_active":"2026-02-24T17:30:37.683226+0000","last_peered":"2026-02-24T17:30:37.683226+0000","last_clean":"2026-02-24T17:30:37.683226+0000","last_became_active":"2026-02-24T17:25:36.967440+0000","last_became_peered":"2026-02-24T17:25:36.967440+0000","last_unstale":"2026-02-24T17:30:37.683226+0000","last_undegraded":"2026-02-24T17:30:37.683226+0000","last_fullsized":"2026-02-24T17:30:37.683226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:37.683131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:37.683131+0000","last_clean_scrub_stamp":"2026-02-24T17:30:37.683131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:01:12.456648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.240878+0000","last_change":"2026-02-24T17:30:30.240878+0000","last_active":"2026-02-24T17:30:30.240878+0000","last_peered":"2026-02-24T17:30:30.240878+0000","last_clean":"2026-02-24T17:30:30.240878+0000","last_became_active":"2026-02-24T17:25:36.927701+0000","last_became_peered":"2026-02-24T17:25:36.927701+0000","last_unstale":"2026-02-24T17:30:30.240878+0000","last_undegraded":"2026-02-24T17:30:30.240878+0000","last_fullsized":"2026-02-24T17:30:30.240878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.240829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.240829+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.240829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:40:11.310198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":566,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.474658+0000","last_change":"2026-02-24T17:30:30.474658+0000","last_active":"2026-02-24T17:30:30.474658+0000","last_peered":"2026-02-24T17:30:30.474658+0000","last_clean":"2026-02-24T17:30:30.474658+0000","last_became_active":"2026-02-24T17:25:36.959978+0000","last_became_peered":"2026-02-24T17:25:36.959978+0000","last_unstale":"2026-02-24T17:30:30.474658+0000","last_undegraded":"2026-02-24T17:30:30.474658+0000","last_fullsized":"2026-02-24T17:30:30.474658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.474596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.474596+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.474596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:46:43.988119+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":573,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:32.501110+0000","last_change":"2026-02-24T17:30:32.501110+0000","last_active":"2026-02-24T17:30:32.501110+0000","last_peered":"2026-02-24T17:30:32.501110+0000","last_clean":"2026-02-24T17:30:32.501110+0000","last_became_active":"2026-02-24T17:25:36.947821+0000","last_became_peered":"2026-02-24T17:25:36.947821+0000","last_unstale":"2026-02-24T17:30:32.501110+0000","last_undegraded":"2026-02-24T17:30:32.501110+0000","last_fullsized":"2026-02-24T17:30:32.501110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:32.501060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:32.501060+0000","last_clean_scrub_stamp":"2026-02-24T17:30:32.501060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:47:27.424433+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":570,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:33.149354+0000","last_change":"2026-02-24T17:30:33.149354+0000","last_active":"2026-02-24T17:30:33.149354+0000","last_peered":"2026-02-24T17:30:33.149354+0000","last_clean":"2026-02-24T17:30:33.149354+0000","last_became_active":"2026-02-24T17:25:36.971529+0000","last_became_peered":"2026-02-24T17:25:36.971529+0000","last_unstale":"2026-02-24T17:30:33.149354+0000","last_undegraded":"2026-02-24T17:30:33.149354+0000","last_fullsized":"2026-02-24T17:30:33.149354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:33.149293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:33.149293+0000","last_clean_scrub_stamp":"2026-02-24T17:30:33.149293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:24:14.858818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":570,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:32.186175+0000","last_change":"2026-02-24T17:30:32.186175+0000","last_active":"2026-02-24T17:30:32.186175+0000","last_peered":"2026-02-24T17:30:32.186175+0000","last_clean":"2026-02-24T17:30:32.186175+0000","last_became_active":"2026-02-24T17:25:36.970412+0000","last_became_peered":"2026-02-24T17:25:36.970412+0000","last_unstale":"2026-02-24T17:30:32.186175+0000","last_undegraded":"2026-02-24T17:30:32.186175+0000","last_fullsized":"2026-02-24T17:30:32.186175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:32.186121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:32.186121+0000","last_clean_scrub_stamp":"2026-02-24T17:30:32.186121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:05:05.882206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":572,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:35.292266+0000","last_change":"2026-02-24T17:30:35.292212+0000","last_active":"2026-02-24T17:30:35.292266+0000","last_peered":"2026-02-24T17:30:35.292266+0000","last_clean":"2026-02-24T17:30:35.292266+0000","last_became_active":"2026-02-24T17:25:37.003886+0000","last_became_peered":"2026-02-24T17:25:37.003886+0000","last_unstale":"2026-02-24T17:30:35.292266+0000","last_undegraded":"2026-02-24T17:30:35.292266+0000","last_fullsized":"2026-02-24T17:30:35.292266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:35.292155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:35.292155+0000","last_clean_scrub_stamp":"2026-02-24T17:30:35.292155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:36:55.157147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":573,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.264491+0000","last_change":"2026-02-24T17:30:30.264445+0000","last_active":"2026-02-24T17:30:30.264491+0000","last_peered":"2026-02-24T17:30:30.264491+0000","last_clean":"2026-02-24T17:30:30.264491+0000","last_became_active":"2026-02-24T17:25:36.942964+0000","last_became_peered":"2026-02-24T17:25:36.942964+0000","last_unstale":"2026-02-24T17:30:30.264491+0000","last_undegraded":"2026-02-24T17:30:30.264491+0000","last_fullsized":"2026-02-24T17:30:30.264491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.264381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.264381+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.264381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:11:30.432837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":566,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:29.513011+0000","last_change":"2026-02-24T17:30:29.513011+0000","last_active":"2026-02-24T17:30:29.513011+0000","last_peered":"2026-02-24T17:30:29.513011+0000","last_clean":"2026-02-24T17:30:29.513011+0000","last_became_active":"2026-02-24T17:25:36.953877+0000","last_became_peered":"2026-02-24T17:25:36.953877+0000","last_unstale":"2026-02-24T17:30:29.513011+0000","last_undegraded":"2026-02-24T17:30:29.513011+0000","last_fullsized":"2026-02-24T17:30:29.513011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:29.512956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:29.512956+0000","last_clean_scrub_stamp":"2026-02-24T17:30:29.512956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:42:02.662093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":572,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:33.273882+0000","last_change":"2026-02-24T17:30:33.273882+0000","last_active":"2026-02-24T17:30:33.273882+0000","last_peered":"2026-02-24T17:30:33.273882+0000","last_clean":"2026-02-24T17:30:33.273882+0000","last_became_active":"2026-02-24T17:25:36.996719+0000","last_became_peered":"2026-02-24T17:25:36.996719+0000","last_unstale":"2026-02-24T17:30:33.273882+0000","last_undegraded":"2026-02-24T17:30:33.273882+0000","last_fullsized":"2026-02-24T17:30:33.273882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:33.273820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:33.273820+0000","last_clean_scrub_stamp":"2026-02-24T17:30:33.273820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:35:53.313680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":585,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.161032+0000","last_change":"2026-02-24T17:30:31.161032+0000","last_active":"2026-02-24T17:30:31.161032+0000","last_peered":"2026-02-24T17:30:31.161032+0000","last_clean":"2026-02-24T17:30:31.161032+0000","last_became_active":"2026-02-24T17:25:08.378421+0000","last_became_peered":"2026-02-24T17:25:08.378421+0000","last_unstale":"2026-02-24T17:30:31.161032+0000","last_undegraded":"2026-02-24T17:30:31.161032+0000","last_fullsized":"2026-02-24T17:30:31.161032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.160980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.160980+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.160980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:23.171614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048673199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:36.642790+0000","last_change":"2026-02-24T17:30:36.642790+0000","last_active":"2026-02-24T17:30:36.642790+0000","last_peered":"2026-02-24T17:30:36.642790+0000","last_clean":"2026-02-24T17:30:36.642790+0000","last_became_active":"2026-02-24T17:25:36.959088+0000","last_became_peered":"2026-02-24T17:25:36.959088+0000","last_unstale":"2026-02-24T17:30:36.642790+0000","last_undegraded":"2026-02-24T17:30:36.642790+0000","last_fullsized":"2026-02-24T17:30:36.642790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:36.642745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:36.642745+0000","last_clean_scrub_stamp":"2026-02-24T17:30:36.642745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:41:04.995574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":588,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:32.844039+0000","last_change":"2026-02-24T17:30:32.844039+0000","last_active":"2026-02-24T17:30:32.844039+0000","last_peered":"2026-02-24T17:30:32.844039+0000","last_clean":"2026-02-24T17:30:32.844039+0000","last_became_active":"2026-02-24T17:25:07.858311+0000","last_became_peered":"2026-02-24T17:25:07.858311+0000","last_unstale":"2026-02-24T17:30:32.844039+0000","last_undegraded":"2026-02-24T17:30:32.844039+0000","last_fullsized":"2026-02-24T17:30:32.844039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:32.843959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:32.843959+0000","last_clean_scrub_stamp":"2026-02-24T17:30:32.843959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:11:25.103225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030397399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:35.690556+0000","last_change":"2026-02-24T17:30:35.690556+0000","last_active":"2026-02-24T17:30:35.690556+0000","last_peered":"2026-02-24T17:30:35.690556+0000","last_clean":"2026-02-24T17:30:35.690556+0000","last_became_active":"2026-02-24T17:25:36.949632+0000","last_became_peered":"2026-02-24T17:25:36.949632+0000","last_unstale":"2026-02-24T17:30:35.690556+0000","last_undegraded":"2026-02-24T17:30:35.690556+0000","last_fullsized":"2026-02-24T17:30:35.690556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:35.690498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:35.690498+0000","last_clean_scrub_stamp":"2026-02-24T17:30:35.690498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:55:55.688053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":583,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.327708+0000","last_change":"2026-02-24T17:30:30.327708+0000","last_active":"2026-02-24T17:30:30.327708+0000","last_peered":"2026-02-24T17:30:30.327708+0000","last_clean":"2026-02-24T17:30:30.327708+0000","last_became_active":"2026-02-24T17:25:08.084075+0000","last_became_peered":"2026-02-24T17:25:08.084075+0000","last_unstale":"2026-02-24T17:30:30.327708+0000","last_undegraded":"2026-02-24T17:30:30.327708+0000","last_fullsized":"2026-02-24T17:30:30.327708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.327657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.327657+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.327657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:14:22.239778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000244684,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":567,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:33.603859+0000","last_change":"2026-02-24T17:30:33.603859+0000","last_active":"2026-02-24T17:30:33.603859+0000","last_peered":"2026-02-24T17:30:33.603859+0000","last_clean":"2026-02-24T17:30:33.603859+0000","last_became_active":"2026-02-24T17:25:36.941218+0000","last_became_peered":"2026-02-24T17:25:36.941218+0000","last_unstale":"2026-02-24T17:30:33.603859+0000","last_undegraded":"2026-02-24T17:30:33.603859+0000","last_fullsized":"2026-02-24T17:30:33.603859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:33.603803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:33.603803+0000","last_clean_scrub_stamp":"2026-02-24T17:30:33.603803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:50:49.558370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":586,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:32.660013+0000","last_change":"2026-02-24T17:30:32.660013+0000","last_active":"2026-02-24T17:30:32.660013+0000","last_peered":"2026-02-24T17:30:32.660013+0000","last_clean":"2026-02-24T17:30:32.660013+0000","last_became_active":"2026-02-24T17:25:07.858281+0000","last_became_peered":"2026-02-24T17:25:07.858281+0000","last_unstale":"2026-02-24T17:30:32.660013+0000","last_undegraded":"2026-02-24T17:30:32.660013+0000","last_fullsized":"2026-02-24T17:30:32.660013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:32.659962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:32.659962+0000","last_clean_scrub_stamp":"2026-02-24T17:30:32.659962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:25.658895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028402800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":568,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:28.167714+0000","last_change":"2026-02-24T17:30:28.167714+0000","last_active":"2026-02-24T17:30:28.167714+0000","last_peered":"2026-02-24T17:30:28.167714+0000","last_clean":"2026-02-24T17:30:28.167714+0000","last_became_active":"2026-02-24T17:25:36.943923+0000","last_became_peered":"2026-02-24T17:25:36.943923+0000","last_unstale":"2026-02-24T17:30:28.167714+0000","last_undegraded":"2026-02-24T17:30:28.167714+0000","last_fullsized":"2026-02-24T17:30:28.167714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:28.167634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:28.167634+0000","last_clean_scrub_stamp":"2026-02-24T17:30:28.167634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:01:18.091188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,15],"acting":[0,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"311'3","reported_seq":588,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.124308+0000","last_change":"2026-02-24T17:30:30.124308+0000","last_active":"2026-02-24T17:30:30.124308+0000","last_peered":"2026-02-24T17:30:30.124308+0000","last_clean":"2026-02-24T17:30:30.124308+0000","last_became_active":"2026-02-24T17:25:08.074872+0000","last_became_peered":"2026-02-24T17:25:08.074872+0000","last_unstale":"2026-02-24T17:30:30.124308+0000","last_undegraded":"2026-02-24T17:30:30.124308+0000","last_fullsized":"2026-02-24T17:30:30.124308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"311'3","last_scrub_stamp":"2026-02-24T17:30:30.124268+0000","last_deep_scrub":"311'3","last_deep_scrub_stamp":"2026-02-24T17:30:30.124268+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.124268+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:15:34.113677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089238299999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":566,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:28.532303+0000","last_change":"2026-02-24T17:30:28.532303+0000","last_active":"2026-02-24T17:30:28.532303+0000","last_peered":"2026-02-24T17:30:28.532303+0000","last_clean":"2026-02-24T17:30:28.532303+0000","last_became_active":"2026-02-24T17:25:36.947822+0000","last_became_peered":"2026-02-24T17:25:36.947822+0000","last_unstale":"2026-02-24T17:30:28.532303+0000","last_undegraded":"2026-02-24T17:30:28.532303+0000","last_fullsized":"2026-02-24T17:30:28.532303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:28.532242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:28.532242+0000","last_clean_scrub_stamp":"2026-02-24T17:30:28.532242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:19:25.661320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":585,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.711280+0000","last_change":"2026-02-24T17:30:31.711280+0000","last_active":"2026-02-24T17:30:31.711280+0000","last_peered":"2026-02-24T17:30:31.711280+0000","last_clean":"2026-02-24T17:30:31.711280+0000","last_became_active":"2026-02-24T17:25:07.860331+0000","last_became_peered":"2026-02-24T17:25:07.860331+0000","last_unstale":"2026-02-24T17:30:31.711280+0000","last_undegraded":"2026-02-24T17:30:31.711280+0000","last_fullsized":"2026-02-24T17:30:31.711280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.711232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.711232+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.711232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:44:33.094404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023849400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":572,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.317203+0000","last_change":"2026-02-24T17:30:31.317203+0000","last_active":"2026-02-24T17:30:31.317203+0000","last_peered":"2026-02-24T17:30:31.317203+0000","last_clean":"2026-02-24T17:30:31.317203+0000","last_became_active":"2026-02-24T17:25:36.988342+0000","last_became_peered":"2026-02-24T17:25:36.988342+0000","last_unstale":"2026-02-24T17:30:31.317203+0000","last_undegraded":"2026-02-24T17:30:31.317203+0000","last_fullsized":"2026-02-24T17:30:31.317203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.317129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.317129+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.317129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:56:43.110737+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":585,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:29.150400+0000","last_change":"2026-02-24T17:30:29.150400+0000","last_active":"2026-02-24T17:30:29.150400+0000","last_peered":"2026-02-24T17:30:29.150400+0000","last_clean":"2026-02-24T17:30:29.150400+0000","last_became_active":"2026-02-24T17:25:08.184697+0000","last_became_peered":"2026-02-24T17:25:08.184697+0000","last_unstale":"2026-02-24T17:30:29.150400+0000","last_undegraded":"2026-02-24T17:30:29.150400+0000","last_fullsized":"2026-02-24T17:30:29.150400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:29.150340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:29.150340+0000","last_clean_scrub_stamp":"2026-02-24T17:30:29.150340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:14:14.609486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064636800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":572,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:34.299332+0000","last_change":"2026-02-24T17:30:34.299332+0000","last_active":"2026-02-24T17:30:34.299332+0000","last_peered":"2026-02-24T17:30:34.299332+0000","last_clean":"2026-02-24T17:30:34.299332+0000","last_became_active":"2026-02-24T17:25:36.995692+0000","last_became_peered":"2026-02-24T17:25:36.995692+0000","last_unstale":"2026-02-24T17:30:34.299332+0000","last_undegraded":"2026-02-24T17:30:34.299332+0000","last_fullsized":"2026-02-24T17:30:34.299332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:34.299277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:34.299277+0000","last_clean_scrub_stamp":"2026-02-24T17:30:34.299277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:50.549491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"311'2","reported_seq":587,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:32.747681+0000","last_change":"2026-02-24T17:30:32.747681+0000","last_active":"2026-02-24T17:30:32.747681+0000","last_peered":"2026-02-24T17:30:32.747681+0000","last_clean":"2026-02-24T17:30:32.747681+0000","last_became_active":"2026-02-24T17:25:08.090187+0000","last_became_peered":"2026-02-24T17:25:08.090187+0000","last_unstale":"2026-02-24T17:30:32.747681+0000","last_undegraded":"2026-02-24T17:30:32.747681+0000","last_fullsized":"2026-02-24T17:30:32.747681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"311'2","last_scrub_stamp":"2026-02-24T17:30:32.747616+0000","last_deep_scrub":"311'2","last_deep_scrub_stamp":"2026-02-24T17:30:32.747616+0000","last_clean_scrub_stamp":"2026-02-24T17:30:32.747616+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:29:45.785114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024157000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"311'194","reported_seq":813,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.556643+0000","last_change":"2026-02-24T17:30:31.556643+0000","last_active":"2026-02-24T17:30:31.556643+0000","last_peered":"2026-02-24T17:30:31.556643+0000","last_clean":"2026-02-24T17:30:31.556643+0000","last_became_active":"2026-02-24T17:25:04.113696+0000","last_became_peered":"2026-02-24T17:25:04.113696+0000","last_unstale":"2026-02-24T17:30:31.556643+0000","last_undegraded":"2026-02-24T17:30:31.556643+0000","last_fullsized":"2026-02-24T17:30:31.556643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"311'194","last_scrub_stamp":"2026-02-24T17:30:31.556586+0000","last_deep_scrub":"311'194","last_deep_scrub_stamp":"2026-02-24T17:30:31.556586+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.556586+0000","objects_scrubbed":2,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:57:33.535557+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:38.664011+0000","last_change":"2026-02-24T17:30:38.664011+0000","last_active":"2026-02-24T17:30:38.664011+0000","last_peered":"2026-02-24T17:30:38.664011+0000","last_clean":"2026-02-24T17:30:38.664011+0000","last_became_active":"2026-02-24T17:25:36.949323+0000","last_became_peered":"2026-02-24T17:25:36.949323+0000","last_unstale":"2026-02-24T17:30:38.664011+0000","last_undegraded":"2026-02-24T17:30:38.664011+0000","last_fullsized":"2026-02-24T17:30:38.664011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:38.663916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:38.663916+0000","last_clean_scrub_stamp":"2026-02-24T17:30:38.663916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:00.409143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":566,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:30.190690+0000","last_change":"2026-02-24T17:30:30.190690+0000","last_active":"2026-02-24T17:30:30.190690+0000","last_peered":"2026-02-24T17:30:30.190690+0000","last_clean":"2026-02-24T17:30:30.190690+0000","last_became_active":"2026-02-24T17:25:36.939263+0000","last_became_peered":"2026-02-24T17:25:36.939263+0000","last_unstale":"2026-02-24T17:30:30.190690+0000","last_undegraded":"2026-02-24T17:30:30.190690+0000","last_fullsized":"2026-02-24T17:30:30.190690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:30.190634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:30.190634+0000","last_clean_scrub_stamp":"2026-02-24T17:30:30.190634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:00:49.298451+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":567,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:32.588611+0000","last_change":"2026-02-24T17:30:32.588611+0000","last_active":"2026-02-24T17:30:32.588611+0000","last_peered":"2026-02-24T17:30:32.588611+0000","last_clean":"2026-02-24T17:30:32.588611+0000","last_became_active":"2026-02-24T17:25:36.936185+0000","last_became_peered":"2026-02-24T17:25:36.936185+0000","last_unstale":"2026-02-24T17:30:32.588611+0000","last_undegraded":"2026-02-24T17:30:32.588611+0000","last_fullsized":"2026-02-24T17:30:32.588611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:32.588536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:32.588536+0000","last_clean_scrub_stamp":"2026-02-24T17:30:32.588536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:03:11.151728+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":570,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:33.771761+0000","last_change":"2026-02-24T17:30:33.771761+0000","last_active":"2026-02-24T17:30:33.771761+0000","last_peered":"2026-02-24T17:30:33.771761+0000","last_clean":"2026-02-24T17:30:33.771761+0000","last_became_active":"2026-02-24T17:25:36.949495+0000","last_became_peered":"2026-02-24T17:25:36.949495+0000","last_unstale":"2026-02-24T17:30:33.771761+0000","last_undegraded":"2026-02-24T17:30:33.771761+0000","last_fullsized":"2026-02-24T17:30:33.771761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:33.771693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:33.771693+0000","last_clean_scrub_stamp":"2026-02-24T17:30:33.771693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:57:25.604306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:34.655695+0000","last_change":"2026-02-24T17:30:34.655695+0000","last_active":"2026-02-24T17:30:34.655695+0000","last_peered":"2026-02-24T17:30:34.655695+0000","last_clean":"2026-02-24T17:30:34.655695+0000","last_became_active":"2026-02-24T17:25:36.988207+0000","last_became_peered":"2026-02-24T17:25:36.988207+0000","last_unstale":"2026-02-24T17:30:34.655695+0000","last_undegraded":"2026-02-24T17:30:34.655695+0000","last_fullsized":"2026-02-24T17:30:34.655695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:34.655644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:34.655644+0000","last_clean_scrub_stamp":"2026-02-24T17:30:34.655644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:08:28.670495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":572,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:32.317256+0000","last_change":"2026-02-24T17:30:32.317256+0000","last_active":"2026-02-24T17:30:32.317256+0000","last_peered":"2026-02-24T17:30:32.317256+0000","last_clean":"2026-02-24T17:30:32.317256+0000","last_became_active":"2026-02-24T17:25:37.002254+0000","last_became_peered":"2026-02-24T17:25:37.002254+0000","last_unstale":"2026-02-24T17:30:32.317256+0000","last_undegraded":"2026-02-24T17:30:32.317256+0000","last_fullsized":"2026-02-24T17:30:32.317256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:32.317192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:32.317192+0000","last_clean_scrub_stamp":"2026-02-24T17:30:32.317192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:32:45.731323+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"311'12","reported_seq":593,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.217936+0000","last_change":"2026-02-24T17:30:31.217936+0000","last_active":"2026-02-24T17:30:31.217936+0000","last_peered":"2026-02-24T17:30:31.217936+0000","last_clean":"2026-02-24T17:30:31.217936+0000","last_became_active":"2026-02-24T17:25:36.954370+0000","last_became_peered":"2026-02-24T17:25:36.954370+0000","last_unstale":"2026-02-24T17:30:31.217936+0000","last_undegraded":"2026-02-24T17:30:31.217936+0000","last_fullsized":"2026-02-24T17:30:31.217936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"311'12","last_scrub_stamp":"2026-02-24T17:30:31.217858+0000","last_deep_scrub":"311'12","last_deep_scrub_stamp":"2026-02-24T17:30:31.217858+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.217858+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:04:15.892289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:33.614129+0000","last_change":"2026-02-24T17:30:33.614129+0000","last_active":"2026-02-24T17:30:33.614129+0000","last_peered":"2026-02-24T17:30:33.614129+0000","last_clean":"2026-02-24T17:30:33.614129+0000","last_became_active":"2026-02-24T17:25:36.967164+0000","last_became_peered":"2026-02-24T17:25:36.967164+0000","last_unstale":"2026-02-24T17:30:33.614129+0000","last_undegraded":"2026-02-24T17:30:33.614129+0000","last_fullsized":"2026-02-24T17:30:33.614129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:33.614082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:33.614082+0000","last_clean_scrub_stamp":"2026-02-24T17:30:33.614082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:11:23.650461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":569,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.824431+0000","last_change":"2026-02-24T17:30:31.824431+0000","last_active":"2026-02-24T17:30:31.824431+0000","last_peered":"2026-02-24T17:30:31.824431+0000","last_clean":"2026-02-24T17:30:31.824431+0000","last_became_active":"2026-02-24T17:25:36.941089+0000","last_became_peered":"2026-02-24T17:25:36.941089+0000","last_unstale":"2026-02-24T17:30:31.824431+0000","last_undegraded":"2026-02-24T17:30:31.824431+0000","last_fullsized":"2026-02-24T17:30:31.824431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.824362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.824362+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.824362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:08:36.857791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:39.697467+0000","last_change":"2026-02-24T17:30:39.697467+0000","last_active":"2026-02-24T17:30:39.697467+0000","last_peered":"2026-02-24T17:30:39.697467+0000","last_clean":"2026-02-24T17:30:39.697467+0000","last_became_active":"2026-02-24T17:25:36.938491+0000","last_became_peered":"2026-02-24T17:25:36.938491+0000","last_unstale":"2026-02-24T17:30:39.697467+0000","last_undegraded":"2026-02-24T17:30:39.697467+0000","last_fullsized":"2026-02-24T17:30:39.697467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:39.697389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:39.697389+0000","last_clean_scrub_stamp":"2026-02-24T17:30:39.697389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:57:54.728046+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":569,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:32.837375+0000","last_change":"2026-02-24T17:30:32.837338+0000","last_active":"2026-02-24T17:30:32.837375+0000","last_peered":"2026-02-24T17:30:32.837375+0000","last_clean":"2026-02-24T17:30:32.837375+0000","last_became_active":"2026-02-24T17:25:36.937025+0000","last_became_peered":"2026-02-24T17:25:36.937025+0000","last_unstale":"2026-02-24T17:30:32.837375+0000","last_undegraded":"2026-02-24T17:30:32.837375+0000","last_fullsized":"2026-02-24T17:30:32.837375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:32.837289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:32.837289+0000","last_clean_scrub_stamp":"2026-02-24T17:30:32.837289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:44:59.663894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":572,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:36.328208+0000","last_change":"2026-02-24T17:30:36.328208+0000","last_active":"2026-02-24T17:30:36.328208+0000","last_peered":"2026-02-24T17:30:36.328208+0000","last_clean":"2026-02-24T17:30:36.328208+0000","last_became_active":"2026-02-24T17:25:36.985324+0000","last_became_peered":"2026-02-24T17:25:36.985324+0000","last_unstale":"2026-02-24T17:30:36.328208+0000","last_undegraded":"2026-02-24T17:30:36.328208+0000","last_fullsized":"2026-02-24T17:30:36.328208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:36.328146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:36.328146+0000","last_clean_scrub_stamp":"2026-02-24T17:30:36.328146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:41:01.050371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":571,"reported_epoch":311,"state":"active+clean","last_fresh":"2026-02-24T17:30:31.285728+0000","last_change":"2026-02-24T17:30:31.285728+0000","last_active":"2026-02-24T17:30:31.285728+0000","last_peered":"2026-02-24T17:30:31.285728+0000","last_clean":"2026-02-24T17:30:31.285728+0000","last_became_active":"2026-02-24T17:25:36.928525+0000","last_became_peered":"2026-02-24T17:25:36.928525+0000","last_unstale":"2026-02-24T17:30:31.285728+0000","last_undegraded":"2026-02-24T17:30:31.285728+0000","last_fullsized":"2026-02-24T17:30:31.285728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T17:30:31.285674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T17:30:31.285674+0000","last_clean_scrub_stamp":"2026-02-24T17:30:31.285674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:37:00.975467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":233,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":2,"acting":2,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":2,"up_from":21,"seq":90194313288,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3248436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189403,"internal_metadata":27401253},"hb_peers":[0,1,3,4,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":21,"seq":90194313289,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2937,"kb_used_meta":24006,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3252877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3007961,"internal_metadata":24582695},"hb_peers":[0,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313290,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2993,"kb_used_meta":23950,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3267610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3065731,"internal_metadata":24524925},"hb_peers":[0,4,5,6,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313290,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":5412,"kb_used_omap":2970,"kb_used_meta":23973,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":5541888,"data_stored":3259528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3041792,"internal_metadata":24548864},"hb_peers":[1,3,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313289,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":5444,"kb_used_omap":5476,"kb_used_meta":21467,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":5574656,"data_stored":3262696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5607519,"internal_metadata":21983137},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313288,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":5400,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":5529600,"data_stored":3255127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[0,2,3,4,6,7,9,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313288,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":5428,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":5558272,"data_stored":3264371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3063988,"internal_metadata":24526668},"hb_peers":[0,2,4,5,7,8,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313288,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":5396,"kb_used_omap":183,"kb_used_meta":26760,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":5525504,"data_stored":3244929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":187407,"internal_metadata":27403249},"hb_peers":[1,3,5,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313289,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":5976,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":6119424,"data_stored":3835511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":192289,"internal_metadata":27398367},"hb_peers":[2,4,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313288,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":6020,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":6164480,"data_stored":3841297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188812,"internal_metadata":27401844},"hb_peers":[0,1,3,5,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313288,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":5468,"kb_used_omap":188,"kb_used_meta":26755,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":5599232,"data_stored":3272622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":193209,"internal_metadata":27397447},"hb_peers":[0,1,6,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313289,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":5448,"kb_used_omap":187,"kb_used_meta":26756,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":5578752,"data_stored":3262562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":191672,"internal_metadata":27398984},"hb_peers":[0,3,5,6,7,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313289,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":5404,"kb_used_omap":184,"kb_used_meta":26759,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":5533696,"data_stored":3252627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":188970,"internal_metadata":27401686},"hb_peers":[2,4,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313288,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":5436,"kb_used_omap":2992,"kb_used_meta":23951,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":5566464,"data_stored":3261683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3064212,"internal_metadata":24526444},"hb_peers":[0,4,5,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313288,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":2994,"kb_used_meta":23949,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3265804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3066142,"internal_metadata":24524514},"hb_peers":[0,2,3,4,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313289,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":5452,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":5582848,"data_stored":3257291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190563,"internal_metadata":27400093},"hb_peers":[1,3,4,6,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T17:30:52.698 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-24T17:30:52.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.759+0000 7f2e6265b640 1 Processor -- start 2026-02-24T17:30:52.761 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.759+0000 7f2e6265b640 1 -- start start 2026-02-24T17:30:52.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f2e5c15af70 0x7f2e5c05e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 -- --> v1:10.20.193.94:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e5c05cd70 con 0x7f2e5c0b2810 2026-02-24T17:30:52.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 -- --> v1:10.20.193.109:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e5c05d010 con 0x7f2e5c15b340 2026-02-24T17:30:52.762 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 -- --> v2:10.20.193.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5c05e5f0 con 0x7f2e5c15af70 2026-02-24T17:30:52.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5bfff640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f2e5c15af70 0x7f2e5c05e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5bfff640 1 --2- >> v2:10.20.193.40:3300/0 conn(0x7f2e5c15af70 0x7f2e5c05e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:54630/0 (socket says 10.20.193.40:54630) 2026-02-24T17:30:52.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5bfff640 1 -- 10.20.193.40:0/2838581708 learned_addr learned my addr 10.20.193.40:0/2838581708 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:52.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5bfff640 1 -- 10.20.193.40:0/2838581708 >> v1:10.20.193.109:6789/0 conn(0x7f2e5c15b340 legacy=0x7f2e5c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:52.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5bfff640 1 -- 10.20.193.40:0/2838581708 >> v1:10.20.193.94:6789/0 conn(0x7f2e5c0b2810 legacy=0x7f2e5c164790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T17:30:52.763 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5bfff640 1 -- 10.20.193.40:0/2838581708 --> v2:10.20.193.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c05d2f0 con 0x7f2e5c15af70 2026-02-24T17:30:52.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5bfff640 1 --2- 10.20.193.40:0/2838581708 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c05e0b0 secure :-1 s=READY pgs=5236 gs=3 cs=0 l=1 c_cookie=16979803765046797779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e48009910 tx=0x7f2e4801ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba4618fbb7465d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:52.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5affd640 1 -- 10.20.193.40:0/2838581708 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e480a8ab0 con 0x7f2e5c15af70 2026-02-24T17:30:52.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5affd640 1 -- 10.20.193.40:0/2838581708 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e480a8c50 con 0x7f2e5c15af70 2026-02-24T17:30:52.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e5affd640 1 -- 10.20.193.40:0/2838581708 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e480b0670 con 0x7f2e5c15af70 2026-02-24T17:30:52.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 -- 10.20.193.40:0/2838581708 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 msgr2=0x7f2e5c05e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.765 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 --2- 10.20.193.40:0/2838581708 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c05e0b0 secure :-1 s=READY pgs=5236 gs=3 cs=0 l=1 c_cookie=16979803765046797779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e48009910 tx=0x7f2e4801ee10 comp rx=0 tx=0).stop 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 -- 10.20.193.40:0/2838581708 shutdown_connections 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 --2- 10.20.193.40:0/2838581708 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c05e0b0 unknown :-1 s=CLOSED pgs=5236 gs=3 cs=0 l=1 c_cookie=16979803765046797779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 -- 10.20.193.40:0/2838581708 >> 10.20.193.40:0/2838581708 conn(0x7f2e5c0b9020 msgr2=0x7f2e5c0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 -- 10.20.193.40:0/2838581708 shutdown_connections 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 -- 10.20.193.40:0/2838581708 wait complete. 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 librados: starting msgr at 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 librados: starting objecter 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.763+0000 7f2e6265b640 1 Processor -- start 2026-02-24T17:30:52.766 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 -- start start 2026-02-24T17:30:52.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 librados: setting wanted keys 2026-02-24T17:30:52.767 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 librados: calling monclient init 2026-02-24T17:30:52.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 --2- >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 0x7f2e5c153f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c155260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 --2- >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 0x7f2e5c1557a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 -- --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c05db90 con 0x7f2e5c15af70 2026-02-24T17:30:52.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 -- --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c05d8b0 con 0x7f2e5c15b340 2026-02-24T17:30:52.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 -- --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c167f30 con 0x7f2e5c0b2810 2026-02-24T17:30:52.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c155260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.772 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c155260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.40:3300/0 says I am v2:10.20.193.40:54642/0 (socket says 10.20.193.40:54642) 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 learned_addr learned my addr 10.20.193.40:0/3208801227 (peer_addr_for_me v2:10.20.193.40:0/0) 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5bfff640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 0x7f2e5c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e60bd1640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 0x7f2e5c1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 msgr2=0x7f2e5c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 0x7f2e5c153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 msgr2=0x7f2e5c1557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 0x7f2e5c1557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c1669e0 con 0x7f2e5c15af70 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e60bd1640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 0x7f2e5c1557a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c155260 secure :-1 s=READY pgs=5237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e4c00c520 tx=0x7f2e4c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:52.773 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 10 client.?.objecter ms_handle_connect 0x7f2e5c15af70 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e4c017070 con 0x7f2e5c15af70 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c006af0 con 0x7f2e5c15af70 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e4c007030 con 0x7f2e5c15af70 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c166c60 con 0x7f2e5c15af70 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 10 client.25524.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c167220 con 0x7f2e5c15af70 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e6265b640 1 librados: init done 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 msgr2=0x7f2e5c155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 msgr2=0x7f2e5c155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c155260 secure :-1 s=READY pgs=5237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e4c00c520 tx=0x7f2e4c00c9e0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-24T17:30:52.774 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c155260 secure :-1 s=READY pgs=5237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e4c00c520 tx=0x7f2e4c00c9e0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 msgr2=0x7f2e5c155260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e5c15af70 0x7f2e5c155260 unknown :-1 s=CLOSED pgs=5237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 0x7f2e2c023940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e2c024280 0x7f2e2c044700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 0x7f2e2c065220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c065c30 con 0x7f2e2c024280 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c065db0 con 0x7f2e5c15b340 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c065f30 con 0x7f2e5c0b2810 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e2c024280 0x7f2e2c044700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.775 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5bfff640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 0x7f2e2c023940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e60bd1640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 0x7f2e2c065220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 msgr2=0x7f2e2c065220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 0x7f2e2c065220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 msgr2=0x7f2e2c023940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 0x7f2e2c023940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f2e2c066260 con 0x7f2e2c024280 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5c0b34c0 con 0x7f2e2c024280 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5c167220 con 0x7f2e2c024280 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 10 client.25524.objecter ms_handle_connect 0x7f2e2c024280 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e5b7fe640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e2c024280 0x7f2e2c044700 secure :-1 s=READY pgs=5238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e4c012780 tx=0x7f2e4c003920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:52.776 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 10 client.25524.objecter resend_mon_ops 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e4c031020 con 0x7f2e2c024280 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0129d0 con 0x7f2e2c024280 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.767+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 3 ==== mgrmap(e 5) ==== 100051+0+0 (secure 0 0 0) 0x7f2e4c012b80 con 0x7f2e2c024280 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e58ff9640 1 --2- 10.20.193.40:0/3208801227 >> v2:10.20.193.120:6800/397309233 conn(0x7f2e5c15af70 0x7f2e2c0f6800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 4 ==== osd_map(311..311 src has 1..311) ==== 7555+0+0 (secure 0 0 0) 0x7f2e4c0982e0 con 0x7f2e2c024280 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e58ff9640 10 client.25524.objecter ms_dispatch2 0x7f2e5c000ba0 osd_map(311..311 src has 1..311) 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e58ff9640 3 client.25524.objecter handle_osd_map got epochs [311,311] > 0 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e58ff9640 3 client.25524.objecter handle_osd_map decoding full epoch 311 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e58ff9640 20 client.25524.objecter dump_active .. 0 homeless 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e5bfff640 1 --2- 10.20.193.40:0/3208801227 >> v2:10.20.193.120:6800/397309233 conn(0x7f2e5c15af70 0x7f2e2c0f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e58ff9640 10 client.25524.objecter ms_handle_connect 0x7f2e5c15af70 2026-02-24T17:30:52.777 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e5bfff640 1 --2- 10.20.193.40:0/3208801227 >> v2:10.20.193.120:6800/397309233 conn(0x7f2e5c15af70 0x7f2e2c0f6800 secure :-1 s=READY pgs=2265 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e48009690 tx=0x7f2e480aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T17:30:52.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.771+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f2e4c02a030 con 0x7f2e2c024280 2026-02-24T17:30:52.778 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.775+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+206765 (secure 0 0 0) 0x7f2e4c021040 con 0x7f2e2c024280 2026-02-24T17:30:52.860 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.859+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 --> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f2e5c139740 con 0x7f2e2c024280 2026-02-24T17:30:52.862 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (secure 0 0 0) 0x7f2e5c1669e0 con 0x7f2e2c024280 2026-02-24T17:30:52.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e58ff9640 1 -- 10.20.193.40:0/3208801227 <== mon.0 v2:10.20.193.40:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2e4c061f30 con 0x7f2e2c024280 2026-02-24T17:30:52.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 10 librados: watch_flush enter 2026-02-24T17:30:52.863 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 10 librados: watch_flush exit 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 20 client.25524.objecter shutdown clearing up homeless session... 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 10 client.25524.objecter successfully canceled tick 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 >> v2:10.20.193.120:6800/397309233 conn(0x7f2e5c15af70 msgr2=0x7f2e2c0f6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 --2- 10.20.193.40:0/3208801227 >> v2:10.20.193.120:6800/397309233 conn(0x7f2e5c15af70 0x7f2e2c0f6800 secure :-1 s=READY pgs=2265 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e48009690 tx=0x7f2e480aa070 comp rx=0 tx=0).stop 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e2c024280 msgr2=0x7f2e2c044700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e2c024280 0x7f2e2c044700 secure :-1 s=READY pgs=5238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e4c012780 tx=0x7f2e4c003920 comp rx=0 tx=0).stop 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 shutdown_connections 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 --2- 10.20.193.40:0/3208801227 >> v2:10.20.193.120:6800/397309233 conn(0x7f2e5c15af70 0x7f2e2c0f6800 unknown :-1 s=CLOSED pgs=2265 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] conn(0x7f2e5c0b2810 0x7f2e2c065220 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] conn(0x7f2e2c024280 0x7f2e2c044700 unknown :-1 s=CLOSED pgs=5238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 --2- 10.20.193.40:0/3208801227 >> [v2:10.20.193.94:3300/0,v1:10.20.193.94:6789/0] conn(0x7f2e5c15b340 0x7f2e2c023940 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 >> 10.20.193.40:0/3208801227 conn(0x7f2e5c0b9020 msgr2=0x7f2e5c139c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 shutdown_connections 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 -- 10.20.193.40:0/3208801227 wait complete. 2026-02-24T17:30:52.864 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-24T17:30:52.863+0000 7f2e6265b640 1 librados: shutdown 2026-02-24T17:30:52.876 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-24T17:30:52.877 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-24T17:30:52.877 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-24T17:30:52.877 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:52.965 INFO:tasks.ceph.osd.0:Stopped 2026-02-24T17:30:52.965 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-24T17:30:52.965 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:53.029 INFO:tasks.ceph.osd.4:Stopped 2026-02-24T17:30:53.029 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-24T17:30:53.029 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:54.867 INFO:tasks.ceph.osd.6.trial109.stderr:2026-02-24T17:30:54.867+0000 7fce6334b640 -1 osd.6 312 handle_osd_map injecting map crc failure 2026-02-24T17:30:59.130 INFO:tasks.ceph.osd.8:Stopped 2026-02-24T17:30:59.130 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-24T17:30:59.130 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.207 INFO:tasks.ceph.osd.12:Stopped 2026-02-24T17:30:59.208 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-24T17:30:59.208 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.288 INFO:tasks.ceph.osd.1:Stopped 2026-02-24T17:30:59.289 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-24T17:30:59.289 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.371 INFO:tasks.ceph.osd.5:Stopped 2026-02-24T17:30:59.371 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-24T17:30:59.371 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.441 INFO:tasks.ceph.osd.9:Stopped 2026-02-24T17:30:59.441 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-24T17:30:59.441 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.457 INFO:tasks.ceph.osd.10.trial109.stderr:2026-02-24T17:30:59.455+0000 7f72dcde3640 -1 osd.10 313 handle_osd_map injecting map crc failure 2026-02-24T17:30:59.526 INFO:tasks.ceph.osd.13:Stopped 2026-02-24T17:30:59.526 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-24T17:30:59.526 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.593 INFO:tasks.ceph.osd.2:Stopped 2026-02-24T17:30:59.593 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-24T17:30:59.593 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.683 INFO:tasks.ceph.osd.6:Stopped 2026-02-24T17:30:59.683 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-24T17:30:59.683 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.778 INFO:tasks.ceph.osd.10:Stopped 2026-02-24T17:30:59.779 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-24T17:30:59.779 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.874 INFO:tasks.ceph.osd.14:Stopped 2026-02-24T17:30:59.875 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-24T17:30:59.875 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:30:59.956 INFO:tasks.ceph.osd.3:Stopped 2026-02-24T17:30:59.957 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-24T17:30:59.957 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:31:00.021 INFO:tasks.ceph.osd.7:Stopped 2026-02-24T17:31:00.021 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-24T17:31:00.021 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:31:00.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 is failed for ~0s 2026-02-24T17:31:05.899 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 is failed for ~0s 2026-02-24T17:31:05.899 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 has been restored 2026-02-24T17:31:06.124 INFO:tasks.ceph.osd.11:Stopped 2026-02-24T17:31:06.124 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-24T17:31:06.124 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:31:06.194 INFO:tasks.ceph.osd.15:Stopped 2026-02-24T17:31:06.194 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-24T17:31:06.194 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-24T17:31:06.194 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:31:06.223 INFO:tasks.ceph.mgr.y:Stopped 2026-02-24T17:31:06.223 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-24T17:31:06.224 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:31:06.251 INFO:tasks.ceph.mgr.x:Stopped 2026-02-24T17:31:06.251 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-24T17:31:06.251 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-24T17:31:06.251 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:31:06.284 INFO:tasks.ceph.mon.a:Stopped 2026-02-24T17:31:06.285 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-24T17:31:06.285 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:31:06.304 INFO:tasks.ceph.mon.b:Stopped 2026-02-24T17:31:06.304 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-24T17:31:06.305 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T17:31:06.323 INFO:tasks.ceph.mon.c:Stopped 2026-02-24T17:31:06.324 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-24T17:31:06.324 DEBUG:teuthology.orchestra.run.trial040:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(REQUEST_STUCK\)' | grep -E -v 'failed to encode map' | grep -E -v '\(OSD_SLOW_PING_TIME' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | grep -E -v 'reached quota' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_AVAILABILITY\)' | head -n 1 2026-02-24T17:31:06.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:31:06.351 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-24T17:31:06.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:31:06.423 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-24T17:31:06.479 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:31:06.479 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-24T17:31:06.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:31:06.531 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-24T17:31:06.583 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:31:06.583 DEBUG:teuthology.orchestra.run.trial094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-24T17:31:06.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:31:06.598 DEBUG:teuthology.orchestra.run.trial094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-24T17:31:06.651 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:31:06.652 DEBUG:teuthology.orchestra.run.trial094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-24T17:31:06.705 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:31:06.706 DEBUG:teuthology.orchestra.run.trial094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-24T17:31:06.757 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:31:06.758 DEBUG:teuthology.orchestra.run.trial109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-24T17:31:06.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:31:06.772 DEBUG:teuthology.orchestra.run.trial109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-24T17:31:06.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:31:06.826 DEBUG:teuthology.orchestra.run.trial109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-24T17:31:06.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:31:06.877 DEBUG:teuthology.orchestra.run.trial109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-24T17:31:06.930 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:31:06.930 DEBUG:teuthology.orchestra.run.trial120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-24T17:31:06.947 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:31:06.947 DEBUG:teuthology.orchestra.run.trial120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-24T17:31:07.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:31:07.001 DEBUG:teuthology.orchestra.run.trial120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-24T17:31:07.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:31:07.060 DEBUG:teuthology.orchestra.run.trial120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-24T17:31:07.111 INFO:tasks.ceph:Archiving mon data... 2026-02-24T17:31:07.113 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/data/mon.a.tgz 2026-02-24T17:31:07.113 DEBUG:teuthology.orchestra.run.trial040:> mktemp 2026-02-24T17:31:07.117 INFO:teuthology.orchestra.run.trial040.stdout:/tmp/tmp.Kk9eljkq01 2026-02-24T17:31:07.117 DEBUG:teuthology.orchestra.run.trial040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Kk9eljkq01 2026-02-24T17:31:07.282 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0666 /tmp/tmp.Kk9eljkq01 2026-02-24T17:31:07.342 DEBUG:teuthology.orchestra.remote:trial040:/tmp/tmp.Kk9eljkq01 is 793KB 2026-02-24T17:31:07.411 DEBUG:teuthology.orchestra.run.trial040:> rm -fr /tmp/tmp.Kk9eljkq01 2026-02-24T17:31:07.415 DEBUG:teuthology.misc:Transferring archived files from trial094:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/data/mon.b.tgz 2026-02-24T17:31:07.416 DEBUG:teuthology.orchestra.run.trial094:> mktemp 2026-02-24T17:31:07.421 INFO:teuthology.orchestra.run.trial094.stdout:/tmp/tmp.c1TnjfdzMq 2026-02-24T17:31:07.421 DEBUG:teuthology.orchestra.run.trial094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.c1TnjfdzMq 2026-02-24T17:31:07.579 DEBUG:teuthology.orchestra.run.trial094:> sudo chmod 0666 /tmp/tmp.c1TnjfdzMq 2026-02-24T17:31:07.635 DEBUG:teuthology.orchestra.remote:trial094:/tmp/tmp.c1TnjfdzMq is 803KB 2026-02-24T17:31:07.696 DEBUG:teuthology.orchestra.run.trial094:> rm -fr /tmp/tmp.c1TnjfdzMq 2026-02-24T17:31:07.701 DEBUG:teuthology.misc:Transferring archived files from trial109:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/data/mon.c.tgz 2026-02-24T17:31:07.701 DEBUG:teuthology.orchestra.run.trial109:> mktemp 2026-02-24T17:31:07.707 INFO:teuthology.orchestra.run.trial109.stdout:/tmp/tmp.iGGTk9Zh67 2026-02-24T17:31:07.707 DEBUG:teuthology.orchestra.run.trial109:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iGGTk9Zh67 2026-02-24T17:31:07.863 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 0666 /tmp/tmp.iGGTk9Zh67 2026-02-24T17:31:07.920 DEBUG:teuthology.orchestra.remote:trial109:/tmp/tmp.iGGTk9Zh67 is 803KB 2026-02-24T17:31:07.984 DEBUG:teuthology.orchestra.run.trial109:> rm -fr /tmp/tmp.iGGTk9Zh67 2026-02-24T17:31:07.989 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-24T17:31:07.989 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T17:31:07.991 DEBUG:teuthology.orchestra.run.trial094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T17:31:07.994 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T17:31:08.031 DEBUG:teuthology.orchestra.run.trial120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T17:31:08.043 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T17:31:08.046 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T17:31:08.082 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T17:31:08.086 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T17:31:08.086 INFO:tasks.ceph:Archiving crash dumps... 2026-02-24T17:31:08.088 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial040/crash 2026-02-24T17:31:08.089 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T17:31:08.099 DEBUG:teuthology.misc:Transferring archived files from trial094:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial094/crash 2026-02-24T17:31:08.100 DEBUG:teuthology.orchestra.run.trial094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T17:31:08.111 DEBUG:teuthology.misc:Transferring archived files from trial109:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial109/crash 2026-02-24T17:31:08.112 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T17:31:08.131 DEBUG:teuthology.misc:Transferring archived files from trial120:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial120/crash 2026-02-24T17:31:08.132 DEBUG:teuthology.orchestra.run.trial120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T17:31:08.141 INFO:tasks.ceph:Compressing logs... 2026-02-24T17:31:08.141 DEBUG:teuthology.orchestra.run.trial040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T17:31:08.145 DEBUG:teuthology.orchestra.run.trial094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T17:31:08.152 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-24T17:31:08.152 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23251.log 2026-02-24T17:31:08.152 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20030.log 2026-02-24T17:31:08.153 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22991.log 2026-02-24T17:31:08.153 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23251.log: /var/log/ceph/ceph-client.admin.20030.log: gzip -5 88.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.20030.log.gz 2026-02-24T17:31:08.153 INFO:teuthology.orchestra.run.trial040.stderr: -- /var/log/ceph/ceph-client.admin.20082.log 2026-02-24T17:31:08.153 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23251.log.gz 2026-02-24T17:31:08.153 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21023.log 2026-02-24T17:31:08.154 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22965.log 2026-02-24T17:31:08.154 INFO:teuthology.orchestra.run.trial040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.22991.log.gz 2026-02-24T17:31:08.154 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21023.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.20082.log.gz 2026-02-24T17:31:08.154 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20596.log 2026-02-24T17:31:08.154 INFO:teuthology.orchestra.run.trial040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.21023.log.gz 2026-02-24T17:31:08.155 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21030.log 2026-02-24T17:31:08.155 DEBUG:teuthology.orchestra.run.trial109:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T17:31:08.155 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22965.log: /var/log/ceph/ceph-client.admin.20596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21288.log 2026-02-24T17:31:08.155 INFO:teuthology.orchestra.run.trial040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.22965.log.gz 2026-02-24T17:31:08.155 INFO:teuthology.orchestra.run.trial040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.20596.log.gz 2026-02-24T17:31:08.155 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20601.log 2026-02-24T17:31:08.156 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21434.log 2026-02-24T17:31:08.156 INFO:teuthology.orchestra.run.trial040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.21030.log.gz 2026-02-24T17:31:08.156 INFO:teuthology.orchestra.run.trial040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.21288.log.gz 2026-02-24T17:31:08.156 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23821.log 2026-02-24T17:31:08.156 INFO:teuthology.orchestra.run.trial040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.20601.log.gz 2026-02-24T17:31:08.156 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23121.log 2026-02-24T17:31:08.156 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21434.log: /var/log/ceph/ceph-client.admin.23821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21027.log 2026-02-24T17:31:08.157 INFO:teuthology.orchestra.run.trial040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.21434.log.gz 2026-02-24T17:31:08.157 INFO:teuthology.orchestra.run.trial040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.23821.log.gz 2026-02-24T17:31:08.157 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23537.log 2026-02-24T17:31:08.157 INFO:teuthology.orchestra.run.trial040.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.23121.log.gz 2026-02-24T17:31:08.157 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20572.log 2026-02-24T17:31:08.158 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23537.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.21027.log.gz 2026-02-24T17:31:08.158 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23563.log 2026-02-24T17:31:08.158 INFO:teuthology.orchestra.run.trial040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23537.log.gz 2026-02-24T17:31:08.158 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23069.log 2026-02-24T17:31:08.158 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23563.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.20572.log.gz 2026-02-24T17:31:08.158 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16381.log 2026-02-24T17:31:08.158 INFO:teuthology.orchestra.run.trial040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.23563.log.gz 2026-02-24T17:31:08.159 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20193.log 2026-02-24T17:31:08.159 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.16381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23771.log 2026-02-24T17:31:08.159 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23069.log.gz 2026-02-24T17:31:08.159 INFO:teuthology.orchestra.run.trial040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.16381.log.gz 2026-02-24T17:31:08.159 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20193.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.20193.log.gz 2026-02-24T17:31:08.159 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19960.log 2026-02-24T17:31:08.160 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23433.log 2026-02-24T17:31:08.160 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.19960.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23771.log.gz 2026-02-24T17:31:08.160 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22834.log 2026-02-24T17:31:08.160 INFO:teuthology.orchestra.run.trial040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.19960.log.gz 2026-02-24T17:31:08.160 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21177.log 2026-02-24T17:31:08.161 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22834.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23433.log.gz 2026-02-24T17:31:08.161 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23407.log 2026-02-24T17:31:08.161 INFO:teuthology.orchestra.run.trial040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.22834.log.gz 2026-02-24T17:31:08.161 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20189.log 2026-02-24T17:31:08.161 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23407.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.21177.log.gz 2026-02-24T17:31:08.161 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21382.log 2026-02-24T17:31:08.162 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20189.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23407.log.gz 2026-02-24T17:31:08.162 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20592.log 2026-02-24T17:31:08.162 INFO:teuthology.orchestra.run.trial094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-24T17:31:08.162 INFO:teuthology.orchestra.run.trial040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.20189.log.gz 2026-02-24T17:31:08.162 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23745.log 2026-02-24T17:31:08.162 INFO:teuthology.orchestra.run.trial094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-24T17:31:08.163 INFO:teuthology.orchestra.run.trial040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.21382.log.gz 2026-02-24T17:31:08.163 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20602.log 2026-02-24T17:31:08.163 INFO:teuthology.orchestra.run.trial094.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-24T17:31:08.163 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20592.log: /var/log/ceph/ceph-client.admin.23745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20177.log 2026-02-24T17:31:08.163 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23745.log.gz 2026-02-24T17:31:08.163 INFO:teuthology.orchestra.run.trial040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.20592.log.gz 2026-02-24T17:31:08.163 INFO:teuthology.orchestra.run.trial094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T17:31:08.163 INFO:teuthology.orchestra.run.trial094.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20996.log 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20177.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.20602.log.gz 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19985.log 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial094.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.20177.log.gz 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20192.log 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial094.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.20996.log.gz 2026-02-24T17:31:08.164 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.19985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22939.log 2026-02-24T17:31:08.165 INFO:teuthology.orchestra.run.trial040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.19985.log.gz 2026-02-24T17:31:08.165 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20010.log 2026-02-24T17:31:08.165 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22939.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20192.log.gz 2026-02-24T17:31:08.165 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22912.log 2026-02-24T17:31:08.165 INFO:teuthology.orchestra.run.trial040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.22939.log.gz 2026-02-24T17:31:08.165 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21173.log 2026-02-24T17:31:08.166 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22912.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-24T17:31:08.166 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.20010.log.gz 2026-02-24T17:31:08.166 INFO:teuthology.orchestra.run.trial040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.22912.log.gz 2026-02-24T17:31:08.166 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23693.log 2026-02-24T17:31:08.166 INFO:teuthology.orchestra.run.trial040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.21173.log.gz 2026-02-24T17:31:08.167 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20998.log 2026-02-24T17:31:08.167 INFO:teuthology.orchestra.run.trial094.stderr:/var/log/ceph/ceph-osd.13.log: /var/log/ceph/ceph-osd.1.log: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T17:31:08.167 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23693.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-24T17:31:08.167 INFO:teuthology.orchestra.run.trial040.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23693.log.gz 2026-02-24T17:31:08.167 INFO:teuthology.orchestra.run.trial094.stderr: 92.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T17:31:08.167 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20966.log 2026-02-24T17:31:08.168 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20181.log 2026-02-24T17:31:08.168 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.8.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.20998.log.gz 2026-02-24T17:31:08.168 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20598.log 2026-02-24T17:31:08.168 INFO:teuthology.orchestra.run.trial040.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.20966.log.gz 2026-02-24T17:31:08.168 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20162.log 2026-02-24T17:31:08.169 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20598.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.20181.log.gz 2026-02-24T17:31:08.169 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11443.log 2026-02-24T17:31:08.169 INFO:teuthology.orchestra.run.trial040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.20598.log.gz 2026-02-24T17:31:08.169 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20585.log 2026-02-24T17:31:08.169 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph.tmp-client.admin.11443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21179.log 2026-02-24T17:31:08.169 INFO:teuthology.orchestra.run.trial040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20162.log.gz 2026-02-24T17:31:08.170 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11443.log.gz 2026-02-24T17:31:08.170 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23095.log 2026-02-24T17:31:08.170 INFO:teuthology.orchestra.run.trial040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.20585.log.gz 2026-02-24T17:31:08.170 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23641.log 2026-02-24T17:31:08.170 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16344.log 2026-02-24T17:31:08.171 INFO:teuthology.orchestra.run.trial040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.21179.log.gz 2026-02-24T17:31:08.171 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.23641.log: -- /var/log/ceph/ceph-client.admin.23199.log 2026-02-24T17:31:08.171 INFO:teuthology.orchestra.run.trial040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.23095.log.gz 2026-02-24T17:31:08.171 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.16344.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23641.log.gz 2026-02-24T17:31:08.171 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23615.log 2026-02-24T17:31:08.171 INFO:teuthology.orchestra.run.trial040.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.16344.log.gz 2026-02-24T17:31:08.171 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20161.log 2026-02-24T17:31:08.172 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23615.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23199.log.gz 2026-02-24T17:31:08.172 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23017.log 2026-02-24T17:31:08.172 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20161.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23615.log.gz 2026-02-24T17:31:08.172 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23277.log 2026-02-24T17:31:08.172 INFO:teuthology.orchestra.run.trial040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.20161.log.gz 2026-02-24T17:31:08.172 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20603.log 2026-02-24T17:31:08.173 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23017.log: /var/log/ceph/ceph-client.admin.23277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23303.log 2026-02-24T17:31:08.173 INFO:teuthology.orchestra.run.trial040.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.23277.log.gz 2026-02-24T17:31:08.173 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23017.log.gz 2026-02-24T17:31:08.173 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20597.log 2026-02-24T17:31:08.173 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23303.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.20603.log.gz 2026-02-24T17:31:08.174 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20571.log 2026-02-24T17:31:08.174 INFO:teuthology.orchestra.run.trial040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23303.log.gz 2026-02-24T17:31:08.174 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20997.log 2026-02-24T17:31:08.174 INFO:teuthology.orchestra.run.trial040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.20597.log.gz 2026-02-24T17:31:08.174 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20576.log 2026-02-24T17:31:08.174 INFO:teuthology.orchestra.run.trial040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.20571.log.gz 2026-02-24T17:31:08.174 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20985.log 2026-02-24T17:31:08.175 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20576.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.20997.log.gz 2026-02-24T17:31:08.175 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T17:31:08.175 INFO:teuthology.orchestra.run.trial040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.20576.log.gz 2026-02-24T17:31:08.175 DEBUG:teuthology.orchestra.run.trial120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T17:31:08.176 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20982.log 2026-02-24T17:31:08.176 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20985.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23589.log 2026-02-24T17:31:08.176 INFO:teuthology.orchestra.run.trial040.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.20985.log.gz 2026-02-24T17:31:08.176 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20589.log 2026-02-24T17:31:08.176 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23589.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.20982.log.gz 2026-02-24T17:31:08.176 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20191.log 2026-02-24T17:31:08.176 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23589.log.gz 2026-02-24T17:31:08.177 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16506.log 2026-02-24T17:31:08.177 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20191.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.20589.log.gz 2026-02-24T17:31:08.177 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23797.log 2026-02-24T17:31:08.177 INFO:teuthology.orchestra.run.trial040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.20191.log.gz 2026-02-24T17:31:08.177 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.16506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23329.log 2026-02-24T17:31:08.178 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23797.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.16506.log.gz 2026-02-24T17:31:08.178 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T17:31:08.178 INFO:teuthology.orchestra.run.trial040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23797.log.gz 2026-02-24T17:31:08.178 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20108.log 2026-02-24T17:31:08.178 INFO:teuthology.orchestra.run.trial040.stderr: 92.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T17:31:08.179 INFO:teuthology.orchestra.run.trial040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23329.log.gz 2026-02-24T17:31:08.179 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20168.log 2026-02-24T17:31:08.179 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20108.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-24T17:31:08.179 INFO:teuthology.orchestra.run.trial040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.20108.log.gz 2026-02-24T17:31:08.179 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20171.log 2026-02-24T17:31:08.179 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.20168.log.gz 2026-02-24T17:31:08.180 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23147.log 2026-02-24T17:31:08.180 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23459.log 2026-02-24T17:31:08.180 INFO:teuthology.orchestra.run.trial040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.20171.log.gz 2026-02-24T17:31:08.180 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20581.log 2026-02-24T17:31:08.181 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20157.log 2026-02-24T17:31:08.181 INFO:teuthology.orchestra.run.trial040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23147.log.gz 2026-02-24T17:31:08.181 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20581.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23459.log.gz 2026-02-24T17:31:08.181 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20185.log 2026-02-24T17:31:08.181 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20157.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.20581.log.gz 2026-02-24T17:31:08.182 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23043.log 2026-02-24T17:31:08.182 INFO:teuthology.orchestra.run.trial040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.20157.log.gz 2026-02-24T17:31:08.182 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20994.log 2026-02-24T17:31:08.182 INFO:teuthology.orchestra.run.trial040.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T17:31:08.182 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-24T17:31:08.183 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23043.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.20185.log.gz 2026-02-24T17:31:08.183 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23719.log 2026-02-24T17:31:08.183 INFO:teuthology.orchestra.run.trial040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23043.log.gz 2026-02-24T17:31:08.183 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22886.log 2026-02-24T17:31:08.183 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-24T17:31:08.183 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-24T17:31:08.183 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T17:31:08.183 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-24T17:31:08.184 INFO:teuthology.orchestra.run.trial040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.20994.log.gz 2026-02-24T17:31:08.184 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20056.log 2026-02-24T17:31:08.184 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19901.log 2026-02-24T17:31:08.184 INFO:teuthology.orchestra.run.trial040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.23719.log.gz 2026-02-24T17:31:08.184 INFO:teuthology.orchestra.run.trial040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.22886.log.gz 2026-02-24T17:31:08.184 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23355.log 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial109.stderr:gzip/var/log/ceph/ceph-osd.2.log: -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.19901.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.20056.log.gz 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23485.log 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20604.log 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.19901.log.gz 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23485.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23355.log.gz 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23667.log 2026-02-24T17:31:08.185 INFO:teuthology.orchestra.run.trial040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23485.log.gz 2026-02-24T17:31:08.186 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20604.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-24T17:31:08.186 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20186.log 2026-02-24T17:31:08.186 INFO:teuthology.orchestra.run.trial040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20604.log.gz 2026-02-24T17:31:08.186 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.0.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23667.log.gz 2026-02-24T17:31:08.186 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23381.log 2026-02-24T17:31:08.186 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20167.log 2026-02-24T17:31:08.187 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23381.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.23511.log 2026-02-24T17:31:08.187 INFO:teuthology.orchestra.run.trial040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.20186.log.gz 2026-02-24T17:31:08.187 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20167.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.23381.log.gz 2026-02-24T17:31:08.187 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23173.log 2026-02-24T17:31:08.187 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph.log: 92.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T17:31:08.188 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23511.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.20167.log.gz 2026-02-24T17:31:08.188 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20194.log 2026-02-24T17:31:08.188 INFO:teuthology.orchestra.run.trial040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.23511.log.gz 2026-02-24T17:31:08.188 INFO:teuthology.orchestra.run.trial109.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T17:31:08.188 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23225.log 2026-02-24T17:31:08.188 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20194.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.23173.log.gz 2026-02-24T17:31:08.188 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20173.log 2026-02-24T17:31:08.188 INFO:teuthology.orchestra.run.trial040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.20194.log.gz 2026-02-24T17:31:08.189 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20911.log 2026-02-24T17:31:08.189 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20173.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23225.log.gz 2026-02-24T17:31:08.189 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-24T17:31:08.189 INFO:teuthology.orchestra.run.trial040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.20173.log.gz 2026-02-24T17:31:08.190 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21408.log 2026-02-24T17:31:08.190 INFO:teuthology.orchestra.run.trial040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.20911.log.gz 2026-02-24T17:31:08.190 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5/var/log/ceph/ceph-mgr.y.log: --verbose -- /var/log/ceph/ceph-client.admin.22860.log 2026-02-24T17:31:08.190 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20993.log 2026-02-24T17:31:08.190 INFO:teuthology.orchestra.run.trial040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.21408.log.gz 2026-02-24T17:31:08.191 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22860.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.22860.log.gz 2026-02-24T17:31:08.191 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20574.log 2026-02-24T17:31:08.191 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20995.log 2026-02-24T17:31:08.191 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20993.log: /var/log/ceph/ceph-client.admin.20574.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.20574.log.gz 2026-02-24T17:31:08.191 INFO:teuthology.orchestra.run.trial040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.20993.log.gz 2026-02-24T17:31:08.191 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.20995.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.20995.log.gz 2026-02-24T17:31:08.194 INFO:teuthology.orchestra.run.trial040.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-24T17:31:08.196 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21857.log 2026-02-24T17:31:08.196 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20482.log 2026-02-24T17:31:08.197 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20794.log 2026-02-24T17:31:08.197 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21042.log 2026-02-24T17:31:08.198 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16411.log 2026-02-24T17:31:08.198 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21574.log 2026-02-24T17:31:08.198 INFO:teuthology.orchestra.run.trial120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.20794.log.gz 2026-02-24T17:31:08.198 INFO:teuthology.orchestra.run.trial120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.21857.log.gz 2026-02-24T17:31:08.198 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21016.log 2026-02-24T17:31:08.198 INFO:teuthology.orchestra.run.trial120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.16411.log.gz 2026-02-24T17:31:08.199 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21856.log 2026-02-24T17:31:08.199 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21574.log: /var/log/ceph/ceph-client.admin.21016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20582.log 2026-02-24T17:31:08.199 INFO:teuthology.orchestra.run.trial120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.21574.log.gz 2026-02-24T17:31:08.199 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21573.log 2026-02-24T17:31:08.200 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20337.log 2026-02-24T17:31:08.200 INFO:teuthology.orchestra.run.trial120.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.21016.log.gz 2026-02-24T17:31:08.200 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20293.log 2026-02-24T17:31:08.200 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20504.log 2026-02-24T17:31:08.200 INFO:teuthology.orchestra.run.trial120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.21856.log.gz 2026-02-24T17:31:08.200 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20337.log: /var/log/ceph/ceph-client.admin.20293.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-24T17:31:08.201 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20504.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-24T17:31:08.201 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-osd.11.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.20482.log.gz 2026-02-24T17:31:08.201 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21583.log 2026-02-24T17:31:08.201 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20819.log 2026-02-24T17:31:08.202 INFO:teuthology.orchestra.run.trial120.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.21573.log.gz 2026-02-24T17:31:08.202 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16291.log 2026-02-24T17:31:08.202 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21583.log: /var/log/ceph/ceph-client.admin.20819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20801.log 2026-02-24T17:31:08.202 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16264.log 2026-02-24T17:31:08.202 INFO:teuthology.orchestra.run.trial120.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.16291.log.gz 2026-02-24T17:31:08.203 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20246.log 2026-02-24T17:31:08.203 INFO:teuthology.orchestra.run.trial120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.20582.log.gz 2026-02-24T17:31:08.203 INFO:teuthology.orchestra.run.trial120.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.20293.log.gz 2026-02-24T17:31:08.203 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20374.log 2026-02-24T17:31:08.203 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20246.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.16264.log.gz 2026-02-24T17:31:08.203 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20278.log 2026-02-24T17:31:08.203 INFO:teuthology.orchestra.run.trial120.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.21042.log.gz 2026-02-24T17:31:08.204 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20317.log 2026-02-24T17:31:08.204 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20374.log: /var/log/ceph/ceph-client.admin.20278.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.21583.log.gz 2026-02-24T17:31:08.204 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16339.log 2026-02-24T17:31:08.204 INFO:teuthology.orchestra.run.trial120.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.20504.log.gz 2026-02-24T17:31:08.204 INFO:teuthology.orchestra.run.trial120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.20801.log.gz 2026-02-24T17:31:08.204 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20317.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-24T17:31:08.204 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16216.log 2026-02-24T17:31:08.204 INFO:teuthology.orchestra.run.trial120.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.16339.log.gz 2026-02-24T17:31:08.205 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20600.log 2026-02-24T17:31:08.205 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.16216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21074.log 2026-02-24T17:31:08.205 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20600.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.16216.log.gz 2026-02-24T17:31:08.205 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21104.log 2026-02-24T17:31:08.206 INFO:teuthology.orchestra.run.trial120.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.20278.log.gz 2026-02-24T17:31:08.206 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16482.log 2026-02-24T17:31:08.206 INFO:teuthology.orchestra.run.trial120.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.20819.log.gz 2026-02-24T17:31:08.206 INFO:teuthology.orchestra.run.trial120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.20600.log.gz 2026-02-24T17:31:08.206 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20254.log 2026-02-24T17:31:08.206 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21479.log 2026-02-24T17:31:08.207 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16482.log: /var/log/ceph/ceph-client.admin.20254.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.20246.log.gz 2026-02-24T17:31:08.207 INFO:teuthology.orchestra.run.trial120.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.20374.log.gz 2026-02-24T17:31:08.207 INFO:teuthology.orchestra.run.trial120.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.16482.log.gz 2026-02-24T17:31:08.207 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21374.log 2026-02-24T17:31:08.207 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20238.log 2026-02-24T17:31:08.207 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21477.log 2026-02-24T17:31:08.208 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16632.log 2026-02-24T17:31:08.208 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16363.log 2026-02-24T17:31:08.208 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-24T17:31:08.209 INFO:teuthology.orchestra.run.trial120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.16632.log.gz 2026-02-24T17:31:08.209 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20459.log 2026-02-24T17:31:08.209 INFO:teuthology.orchestra.run.trial120.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.21104.log.gz 2026-02-24T17:31:08.209 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-osd.7.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.16363.log.gz 2026-02-24T17:31:08.209 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20270.log 2026-02-24T17:31:08.209 INFO:teuthology.orchestra.run.trial120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.21479.log.gz 2026-02-24T17:31:08.209 INFO:teuthology.orchestra.run.trial120.stderr:gzip/var/log/ceph/ceph-client.admin.20459.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.21425.log 2026-02-24T17:31:08.210 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20270.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.21374.log.gz 2026-02-24T17:31:08.210 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21376.log 2026-02-24T17:31:08.210 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20790.log 2026-02-24T17:31:08.210 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21425.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.21477.log.gz 2026-02-24T17:31:08.210 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21376.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.21074.log.gz 2026-02-24T17:31:08.210 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21480.log 2026-02-24T17:31:08.211 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16680.log 2026-02-24T17:31:08.211 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20384.log 2026-02-24T17:31:08.211 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21480.log: /var/log/ceph/ceph-client.admin.16680.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.16680.log.gz 2026-02-24T17:31:08.211 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-24T17:31:08.212 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20549.log 2026-02-24T17:31:08.212 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20384.log: /var/log/ceph/ceph-osd.15.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.21376.log.gz 2026-02-24T17:31:08.212 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16608.log 2026-02-24T17:31:08.212 INFO:teuthology.orchestra.run.trial120.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.21425.log.gz 2026-02-24T17:31:08.212 INFO:teuthology.orchestra.run.trial120.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.20459.log.gz 2026-02-24T17:31:08.213 INFO:teuthology.orchestra.run.trial120.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.20254.log.gz 2026-02-24T17:31:08.213 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21855.log 2026-02-24T17:31:08.213 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21476.log 2026-02-24T17:31:08.213 INFO:teuthology.orchestra.run.trial120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.16608.log.gz 2026-02-24T17:31:08.213 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16387.log 2026-02-24T17:31:08.213 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21855.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.20790.log.gz 2026-02-24T17:31:08.214 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21476.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.21480.log.gz 2026-02-24T17:31:08.214 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16435.log 2026-02-24T17:31:08.214 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21109.log 2026-02-24T17:31:08.214 INFO:teuthology.orchestra.run.trial120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.16387.log.gz 2026-02-24T17:31:08.214 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20421.log 2026-02-24T17:31:08.214 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21109.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.16435.log.gz 2026-02-24T17:31:08.214 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16240.log 2026-02-24T17:31:08.214 INFO:teuthology.orchestra.run.trial120.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.21476.log.gz 2026-02-24T17:31:08.215 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20421.log: gzip -5 --verbose -- 90.6% -- replaced with /var/log/ceph/ceph-client.admin.20384.log.gz /var/log/ceph/ceph-client.admin.21582.log 2026-02-24T17:31:08.215 INFO:teuthology.orchestra.run.trial120.stderr: 2026-02-24T17:31:08.215 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16240.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.16240.log.gz 2026-02-24T17:31:08.215 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20844.log 2026-02-24T17:31:08.215 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21582.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.20549.log.gz 2026-02-24T17:31:08.215 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16576.log 2026-02-24T17:31:08.216 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20844.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.21582.log.gz 2026-02-24T17:31:08.216 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20440.log 2026-02-24T17:31:08.216 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20776.log 2026-02-24T17:31:08.216 INFO:teuthology.orchestra.run.trial120.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.20844.log.gz 2026-02-24T17:31:08.216 INFO:teuthology.orchestra.run.trial120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.16576.log.gz 2026-02-24T17:31:08.216 INFO:teuthology.orchestra.run.trial120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.21855.log.gz 2026-02-24T17:31:08.217 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20696.log 2026-02-24T17:31:08.217 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16315.log 2026-02-24T17:31:08.217 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20696.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.20696.log.gz 2026-02-24T17:31:08.217 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21478.log 2026-02-24T17:31:08.217 INFO:teuthology.orchestra.run.trial120.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.20421.log.gz 2026-02-24T17:31:08.218 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20777.log 2026-02-24T17:31:08.218 INFO:teuthology.orchestra.run.trial120.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.20440.log.gz 2026-02-24T17:31:08.218 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.16315.log: /var/log/ceph/ceph-client.admin.21478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16656.log 2026-02-24T17:31:08.218 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20777.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.16315.log.gz 2026-02-24T17:31:08.218 INFO:teuthology.orchestra.run.trial120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.20776.log.gz 2026-02-24T17:31:08.218 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21427.log 2026-02-24T17:31:08.219 INFO:teuthology.orchestra.run.trial120.stderr:gzip/var/log/ceph/ceph-client.admin.16656.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.20783.log 2026-02-24T17:31:08.219 INFO:teuthology.orchestra.run.trial120.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.21478.log.gz 2026-02-24T17:31:08.219 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20935.log 2026-02-24T17:31:08.219 INFO:teuthology.orchestra.run.trial120.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.16656.log.gz 2026-02-24T17:31:08.219 INFO:teuthology.orchestra.run.trial120.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.20777.log.gz 2026-02-24T17:31:08.220 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20230.log 2026-02-24T17:31:08.220 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21579.log 2026-02-24T17:31:08.220 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21375.log 2026-02-24T17:31:08.221 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20803.log 2026-02-24T17:31:08.221 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20669.log 2026-02-24T17:31:08.222 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20631.log 2026-02-24T17:31:08.222 INFO:teuthology.orchestra.run.trial120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.21427.log.gz 2026-02-24T17:31:08.222 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20669.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.20803.log.gz 2026-02-24T17:31:08.222 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20804.log 2026-02-24T17:31:08.222 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20631.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.21579.log.gz 2026-02-24T17:31:08.222 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20773.log 2026-02-24T17:31:08.223 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20262.log 2026-02-24T17:31:08.223 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20773.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20804.log.gz 2026-02-24T17:31:08.223 INFO:teuthology.orchestra.run.trial120.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.20783.log.gz 2026-02-24T17:31:08.223 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20399.log 2026-02-24T17:31:08.223 INFO:teuthology.orchestra.run.trial120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.20773.log.gz 2026-02-24T17:31:08.223 INFO:teuthology.orchestra.run.trial120.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.21375.log.gz 2026-02-24T17:31:08.224 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21426.log 2026-02-24T17:31:08.224 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20262.log: /var/log/ceph/ceph-client.admin.20399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20886.log 2026-02-24T17:31:08.224 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.21426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20993.log 2026-02-24T17:31:08.225 INFO:teuthology.orchestra.run.trial120.stderr:/var/log/ceph/ceph-client.admin.20886.log: /var/log/ceph/ceph-client.admin.20993.log: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.20669.log.gz 2026-02-24T17:31:08.225 INFO:teuthology.orchestra.run.trial120.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.20262.log.gz 2026-02-24T17:31:08.226 INFO:teuthology.orchestra.run.trial120.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.21426.log.gz 2026-02-24T17:31:08.229 INFO:teuthology.orchestra.run.trial120.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.20399.log.gz 2026-02-24T17:31:08.229 INFO:teuthology.orchestra.run.trial120.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.20993.log.gz 2026-02-24T17:31:08.230 INFO:teuthology.orchestra.run.trial120.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.20935.log.gz 2026-02-24T17:31:08.232 INFO:teuthology.orchestra.run.trial120.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.20230.log.gz 2026-02-24T17:31:08.239 INFO:teuthology.orchestra.run.trial120.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.21109.log.gz 2026-02-24T17:31:08.240 INFO:teuthology.orchestra.run.trial120.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.20270.log.gz 2026-02-24T17:31:08.241 INFO:teuthology.orchestra.run.trial120.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.20238.log.gz 2026-02-24T17:31:08.241 INFO:teuthology.orchestra.run.trial120.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.20886.log.gz 2026-02-24T17:31:08.243 INFO:teuthology.orchestra.run.trial120.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.20631.log.gz 2026-02-24T17:31:08.245 INFO:teuthology.orchestra.run.trial120.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.20337.log.gz 2026-02-24T17:31:08.298 INFO:teuthology.orchestra.run.trial120.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-24T17:31:08.631 INFO:teuthology.orchestra.run.trial120.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.20317.log.gz 2026-02-24T17:31:09.019 INFO:teuthology.orchestra.run.trial094.stderr: 87.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-24T17:31:09.093 INFO:teuthology.orchestra.run.trial109.stderr: 87.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-24T17:31:09.168 INFO:teuthology.orchestra.run.trial094.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-24T17:31:09.214 INFO:teuthology.orchestra.run.trial094.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-24T17:31:09.218 INFO:teuthology.orchestra.run.trial040.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-24T17:31:09.228 INFO:teuthology.orchestra.run.trial040.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-24T17:31:09.265 INFO:teuthology.orchestra.run.trial109.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-24T17:31:09.271 INFO:teuthology.orchestra.run.trial120.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-24T17:31:09.285 INFO:teuthology.orchestra.run.trial094.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-24T17:31:09.286 INFO:teuthology.orchestra.run.trial040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-24T17:31:09.301 INFO:teuthology.orchestra.run.trial109.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-24T17:31:09.307 INFO:teuthology.orchestra.run.trial120.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-24T17:31:09.310 INFO:teuthology.orchestra.run.trial040.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-24T17:31:09.333 INFO:teuthology.orchestra.run.trial120.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-24T17:31:09.368 INFO:teuthology.orchestra.run.trial109.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-24T17:31:09.380 INFO:teuthology.orchestra.run.trial120.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-24T17:31:09.381 INFO:teuthology.orchestra.run.trial120.stderr: 2026-02-24T17:31:09.381 INFO:teuthology.orchestra.run.trial120.stderr:real 0m1.191s 2026-02-24T17:31:09.381 INFO:teuthology.orchestra.run.trial120.stderr:user 0m5.063s 2026-02-24T17:31:09.381 INFO:teuthology.orchestra.run.trial120.stderr:sys 0m0.312s 2026-02-24T17:31:09.383 INFO:teuthology.orchestra.run.trial040.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-24T17:31:09.384 INFO:teuthology.orchestra.run.trial040.stderr: 2026-02-24T17:31:09.384 INFO:teuthology.orchestra.run.trial040.stderr:real 0m1.238s 2026-02-24T17:31:09.384 INFO:teuthology.orchestra.run.trial040.stderr:user 0m5.469s 2026-02-24T17:31:09.384 INFO:teuthology.orchestra.run.trial040.stderr:sys 0m0.242s 2026-02-24T17:31:09.385 INFO:teuthology.orchestra.run.trial109.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-24T17:31:09.386 INFO:teuthology.orchestra.run.trial109.stderr: 2026-02-24T17:31:09.386 INFO:teuthology.orchestra.run.trial109.stderr:real 0m1.210s 2026-02-24T17:31:09.386 INFO:teuthology.orchestra.run.trial109.stderr:user 0m5.296s 2026-02-24T17:31:09.387 INFO:teuthology.orchestra.run.trial109.stderr:sys 0m0.223s 2026-02-24T17:31:09.491 INFO:teuthology.orchestra.run.trial094.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-24T17:31:09.492 INFO:teuthology.orchestra.run.trial094.stderr: 2026-02-24T17:31:09.492 INFO:teuthology.orchestra.run.trial094.stderr:real 0m1.335s 2026-02-24T17:31:09.492 INFO:teuthology.orchestra.run.trial094.stderr:user 0m5.206s 2026-02-24T17:31:09.492 INFO:teuthology.orchestra.run.trial094.stderr:sys 0m0.177s 2026-02-24T17:31:09.492 INFO:tasks.ceph:Archiving logs... 2026-02-24T17:31:09.492 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial040/log 2026-02-24T17:31:09.497 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T17:31:10.228 DEBUG:teuthology.misc:Transferring archived files from trial094:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial094/log 2026-02-24T17:31:10.229 DEBUG:teuthology.orchestra.run.trial094:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T17:31:10.741 DEBUG:teuthology.misc:Transferring archived files from trial109:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial109/log 2026-02-24T17:31:10.742 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T17:31:10.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 has been restored 2026-02-24T17:31:11.253 DEBUG:teuthology.misc:Transferring archived files from trial120:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial120/log 2026-02-24T17:31:11.254 DEBUG:teuthology.orchestra.run.trial120:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T17:31:11.824 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T17:31:11.832 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T17:31:11.832 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T17:31:11.833 DEBUG:teuthology.orchestra.run.trial094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T17:31:11.834 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T17:31:11.836 DEBUG:teuthology.orchestra.run.trial120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T17:31:14.173 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T17:31:14.185 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T17:31:14.185 DEBUG:teuthology.orchestra.run.trial040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T17:31:14.186 DEBUG:teuthology.orchestra.run.trial094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T17:31:14.187 DEBUG:teuthology.orchestra.run.trial109:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T17:31:14.188 DEBUG:teuthology.orchestra.run.trial120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T17:31:14.216 INFO:teuthology.orchestra.run.trial109.stdout: remote refid st t when poll reach delay offset jitter 2026-02-24T17:31:14.216 INFO:teuthology.orchestra.run.trial109.stdout:============================================================================== 2026-02-24T17:31:14.216 INFO:teuthology.orchestra.run.trial109.stdout:+23.155.72.147 ( 141.11.89.193 3 u 16 64 377 29.966 +0.330 0.834 2026-02-24T17:31:14.216 INFO:teuthology.orchestra.run.trial109.stdout:*frumentum-zeus. 209.180.247.49 2 u 15 64 377 29.772 -2.227 1.768 2026-02-24T17:31:14.216 INFO:teuthology.orchestra.run.trial109.stdout:+white.web-ster. 129.6.15.29 2 u 9 64 377 72.028 -4.311 1.169 2026-02-24T17:31:14.216 INFO:teuthology.orchestra.run.trial109.stdout:-time4.lshiy.com 216.239.35.4 2 u 16 64 377 186.786 -1.687 11.835 2026-02-24T17:31:14.231 INFO:teuthology.orchestra.run.trial120.stdout: remote refid st t when poll reach delay offset jitter 2026-02-24T17:31:14.231 INFO:teuthology.orchestra.run.trial120.stdout:============================================================================== 2026-02-24T17:31:14.231 INFO:teuthology.orchestra.run.trial120.stdout:-23.186.168.132 132.163.97.4 2 u 12 64 377 69.769 -0.978 5.832 2026-02-24T17:31:14.231 INFO:teuthology.orchestra.run.trial120.stdout:+sushi.ruselabs. 2.148.140.233 2 u 14 64 377 66.942 +2.323 2.237 2026-02-24T17:31:14.231 INFO:teuthology.orchestra.run.trial120.stdout:+172-238-164-57. 168.61.215.74 4 u 9 64 377 33.659 -1.364 1.217 2026-02-24T17:31:14.231 INFO:teuthology.orchestra.run.trial120.stdout:*138.89.14.60 (p .PPS. 1 u 12 64 373 5.678 -1.535 1.080 2026-02-24T17:31:14.299 INFO:teuthology.orchestra.run.trial040.stdout: remote refid st t when poll reach delay offset jitter 2026-02-24T17:31:14.299 INFO:teuthology.orchestra.run.trial040.stdout:============================================================================== 2026-02-24T17:31:14.299 INFO:teuthology.orchestra.run.trial040.stdout:*139-177-202-26. 82.43.52.28 2 u 12 64 377 19.936 +5.364 5.789 2026-02-24T17:31:14.299 INFO:teuthology.orchestra.run.trial040.stdout:+170-187-147-56. 81.104.22.229 2 u 9 64 377 20.450 +2.813 4.624 2026-02-24T17:31:14.299 INFO:teuthology.orchestra.run.trial040.stdout:-69.9.131.124 132.163.97.1 2 u 9 64 377 78.384 -11.580 6.004 2026-02-24T17:31:14.299 INFO:teuthology.orchestra.run.trial040.stdout:+time.cloudflare 10.138.8.13 3 u 11 64 377 3.064 +4.577 7.881 2026-02-24T17:31:14.300 INFO:teuthology.orchestra.run.trial094.stdout: remote refid st t when poll reach delay offset jitter 2026-02-24T17:31:14.300 INFO:teuthology.orchestra.run.trial094.stdout:============================================================================== 2026-02-24T17:31:14.300 INFO:teuthology.orchestra.run.trial094.stdout:+139-177-202-26. 82.43.52.28 2 u 14 64 377 19.942 +5.360 1.135 2026-02-24T17:31:14.301 INFO:teuthology.orchestra.run.trial094.stdout:*170-187-147-56. 81.104.22.229 2 u 13 64 377 20.018 +4.355 1.750 2026-02-24T17:31:14.301 INFO:teuthology.orchestra.run.trial094.stdout:-69.9.131.124 132.163.97.1 2 u 11 64 377 78.300 -9.834 1.278 2026-02-24T17:31:14.301 INFO:teuthology.orchestra.run.trial094.stdout:+time.cloudflare 10.237.8.4 3 u 9 64 377 2.990 -3.664 1.177 2026-02-24T17:31:14.301 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T17:31:14.313 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T17:31:14.313 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T17:31:14.327 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T17:31:14.343 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T17:31:14.358 INFO:teuthology.task.internal:Duration was 691.946697 seconds 2026-02-24T17:31:14.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T17:31:14.374 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T17:31:14.374 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T17:31:14.377 DEBUG:teuthology.orchestra.run.trial094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T17:31:14.379 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T17:31:14.382 DEBUG:teuthology.orchestra.run.trial120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T17:31:14.408 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T17:31:14.408 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial040.front.sepia.ceph.com 2026-02-24T17:31:14.408 DEBUG:teuthology.orchestra.run.trial040:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T17:31:14.450 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial094.front.sepia.ceph.com 2026-02-24T17:31:14.451 DEBUG:teuthology.orchestra.run.trial094:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T17:31:14.457 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial109.front.sepia.ceph.com 2026-02-24T17:31:14.457 DEBUG:teuthology.orchestra.run.trial109:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T17:31:14.464 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial120.front.sepia.ceph.com 2026-02-24T17:31:14.464 DEBUG:teuthology.orchestra.run.trial120:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T17:31:14.471 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T17:31:14.471 DEBUG:teuthology.orchestra.run.trial040:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T17:31:14.493 DEBUG:teuthology.orchestra.run.trial094:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T17:31:14.499 DEBUG:teuthology.orchestra.run.trial109:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T17:31:14.511 DEBUG:teuthology.orchestra.run.trial120:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T17:31:14.737 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T17:31:14.737 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T17:31:14.738 DEBUG:teuthology.orchestra.run.trial094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T17:31:14.739 DEBUG:teuthology.orchestra.run.trial109:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T17:31:14.740 DEBUG:teuthology.orchestra.run.trial120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T17:31:14.744 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T17:31:14.745 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T17:31:14.745 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T17:31:14.745 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T17:31:14.745 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T17:31:14.746 INFO:teuthology.orchestra.run.trial094.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T17:31:14.746 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T17:31:14.747 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T17:31:14.747 INFO:teuthology.orchestra.run.trial094.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T17:31:14.747 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T17:31:14.747 INFO:teuthology.orchestra.run.trial094.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T17:31:14.747 INFO:teuthology.orchestra.run.trial094.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T17:31:14.748 INFO:teuthology.orchestra.run.trial109.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T17:31:14.748 INFO:teuthology.orchestra.run.trial109.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T17:31:14.748 INFO:teuthology.orchestra.run.trial094.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T17:31:14.748 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T17:31:14.748 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T17:31:14.748 INFO:teuthology.orchestra.run.trial120.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T17:31:14.749 INFO:teuthology.orchestra.run.trial120.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T17:31:14.749 INFO:teuthology.orchestra.run.trial120.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T17:31:14.817 INFO:teuthology.orchestra.run.trial109.stderr: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T17:31:14.817 INFO:teuthology.orchestra.run.trial094.stderr: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T17:31:14.817 INFO:teuthology.orchestra.run.trial040.stderr: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T17:31:14.821 INFO:teuthology.orchestra.run.trial120.stderr: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T17:31:14.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T17:31:14.833 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T17:31:14.834 DEBUG:teuthology.orchestra.run.trial040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T17:31:14.869 DEBUG:teuthology.orchestra.run.trial094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T17:31:14.878 DEBUG:teuthology.orchestra.run.trial109:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T17:31:14.887 DEBUG:teuthology.orchestra.run.trial120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T17:31:14.896 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T17:31:14.913 DEBUG:teuthology.orchestra.run.trial040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T17:31:14.915 DEBUG:teuthology.orchestra.run.trial094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T17:31:14.922 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern = core 2026-02-24T17:31:14.924 DEBUG:teuthology.orchestra.run.trial109:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T17:31:14.930 INFO:teuthology.orchestra.run.trial094.stdout:kernel.core_pattern = core 2026-02-24T17:31:14.932 DEBUG:teuthology.orchestra.run.trial120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T17:31:14.939 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern = core 2026-02-24T17:31:14.944 INFO:teuthology.orchestra.run.trial120.stdout:kernel.core_pattern = core 2026-02-24T17:31:14.953 DEBUG:teuthology.orchestra.run.trial040:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T17:31:14.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:31:14.976 DEBUG:teuthology.orchestra.run.trial094:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T17:31:14.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:31:14.987 DEBUG:teuthology.orchestra.run.trial109:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T17:31:14.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:31:14.995 DEBUG:teuthology.orchestra.run.trial120:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T17:31:15.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T17:31:15.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T17:31:15.016 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T17:31:15.017 DEBUG:teuthology.misc:Transferring archived files from trial040:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial040 2026-02-24T17:31:15.017 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T17:31:15.063 DEBUG:teuthology.misc:Transferring archived files from trial094:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial094 2026-02-24T17:31:15.063 DEBUG:teuthology.orchestra.run.trial094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T17:31:15.098 DEBUG:teuthology.misc:Transferring archived files from trial109:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial109 2026-02-24T17:31:15.098 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T17:31:15.130 DEBUG:teuthology.misc:Transferring archived files from trial120:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-24_16:03:54-rados-wip-yuri8-testing-2026-02-23-2128-distro-default-trial/68468/remote/trial120 2026-02-24T17:31:15.131 DEBUG:teuthology.orchestra.run.trial120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T17:31:15.178 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T17:31:15.178 DEBUG:teuthology.orchestra.run.trial040:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T17:31:15.180 DEBUG:teuthology.orchestra.run.trial094:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T17:31:15.182 DEBUG:teuthology.orchestra.run.trial109:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T17:31:15.183 DEBUG:teuthology.orchestra.run.trial120:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T17:31:15.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T17:31:15.211 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T17:31:15.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T17:31:15.224 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T17:31:15.225 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T17:31:15.226 DEBUG:teuthology.orchestra.run.trial094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T17:31:15.228 DEBUG:teuthology.orchestra.run.trial109:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T17:31:15.229 INFO:teuthology.orchestra.run.trial040.stdout: 1311292 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 17:31 /home/ubuntu/cephtest 2026-02-24T17:31:15.230 DEBUG:teuthology.orchestra.run.trial120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T17:31:15.231 INFO:teuthology.orchestra.run.trial094.stdout: 1311278 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 17:31 /home/ubuntu/cephtest 2026-02-24T17:31:15.232 INFO:teuthology.orchestra.run.trial109.stdout: 1311292 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 17:31 /home/ubuntu/cephtest 2026-02-24T17:31:15.240 INFO:teuthology.orchestra.run.trial120.stdout: 1311292 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 17:31 /home/ubuntu/cephtest 2026-02-24T17:31:15.241 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T17:31:15.261 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T17:31:15.293 INFO:teuthology.run:Summary data: description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/{bluestore/{alloc$/{hybrid} base mem$/{low} onode-segment$/{512K-onoff} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} duration: 691.946697473526 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-24T17:31:15.293 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T17:31:15.399 INFO:teuthology.run:pass